robots.txt details

saved: size: 203 kb md5 checksum: e4e08e05b9e01bc9b26ac2dfd12dc14b

websites using this robots.txt

content


User-agent: Slurp
Crawl-delay: 60

User-agent: *
Disallow: /openads
Disallow: /48f6543196cbbdefb88f247a0a8e4375

Sitemap: https://taz.de/sitemap-google-news.xml
Sitemap: https://taz.de/sitemap-index.xml