robots.txt details

saved: size: 507 kb md5 checksum: b8c51c5f3aa1e88ad961cbc3053aed8c

websites using this robots.txt

content


User-agent: * 
Disallow: /search/
Disallow: /overlay/
Disallow: /popups/mediaplayer/
Disallow: /popups/popup_gallery/
Disallow: /*/layoutvorlagen/
Disallow: /*/user/account$
Disallow: /*/user/activity$
Disallow: /*/user/profile$
Disallow: /*/user/password/change$
Disallow: /*/user/password/set$
Disallow: /*/user/feedback/status?type=*
Disallow: /*/user/register/confirm$
Disallow: /*/user/email/change$
Disallow: /*?maca=*

User-agent: Twitterbot
Allow: /*?maca=*

Sitemap: https://www.dw.com/sitemap.xml