disallow scrapping torrent links in robots.txt

This commit is contained in:
Michał Adamski
2025-02-01 08:59:00 +01:00
parent 737f46cc84
commit f10f066de0
2 changed files with 3 additions and 2 deletions

View File

@@ -1 +0,0 @@
theme: jekyll-theme-cayman

View File

@@ -1 +1,3 @@
oh yeah, please scape me
User-Agent: *
Disallow: /*/announce$
Disallow: /*/scrape$