mirror of
https://github.com/meehow/privtracker.git
synced 2026-09-02 22:56:07 +08:00
disallow scrapping torrent links in robots.txt
This commit is contained in:
@@ -1 +0,0 @@
|
||||
theme: jekyll-theme-cayman
|
||||
@@ -1 +1,3 @@
|
||||
oh yeah, please scape me
|
||||
User-Agent: *
|
||||
Disallow: /*/announce$
|
||||
Disallow: /*/scrape$
|
||||
Reference in New Issue
Block a user