robots.txt details

saved: size: 444 kb md5 checksum: 1e3e4ec55a589c21ff681a8489609097

websites using this robots.txt

content


User-agent: Googlebot-News
Disallow: /angebote/
Disallow: /zmo-assets/js/web.core/plugins/jquery.clarify.js

User-agent: *
Disallow: /zeit/
Disallow: /text/
Disallow: /templates/
Noindex: /templates/
Disallow: /hp_channels/
Disallow: /send/
Disallow: /website-solr/
Disallow: /suche/
Noindex: /suche/
Disallow: */comment-thread?
Noindex: */comment-thread?

User-agent: Baiduspider
Disallow: /

Sitemap: https://www.zeit.de/gsitemaps/index.xml