robots.txt details

saved: size: 387 kb md5 checksum: db293a118bebb416cb698767f2a5de61

websites using this robots.txt

content


User-agent: Googlebot-News
Disallow: /angebote/

User-agent: *
Disallow: /zeit/
Disallow: /templates/
Noindex: /templates/
Disallow: /hp_channels/
Disallow: /send/
Disallow: /suche/
Noindex: /suche/
Disallow: */comment-thread?
Noindex: */comment-thread?

User-agent: Baiduspider
Disallow: /

User-agent: GrapeshotCrawler
crawl-delay: 3

Sitemap: https://www.zeit.de/gsitemaps/index.xml