robots.txt details

saved: size: 667 kb md5 checksum: 6ec4183461049e96a957fa3f7ff87df0

websites using this robots.txt

content


User-agent: * 
Disallow: /search/
Disallow: /overlay/
Disallow: /popups/mediaplayer/
Disallow: /popups/popup_gallery/
Disallow: _page_0,00.html
Disallow: _page_1,00.html
Disallow: _page_2,00.html
Disallow: _page_3,00.html
Disallow: /*/layoutvorlagen/
Disallow: /*/*/l-*/ler$
Disallow: /*/*/l-*/sum$
Disallow: /*/*/placement-*
Disallow: /*/*/final-*
Disallow: /*/user/account$
Disallow: /*/user/activity$
Disallow: /*/user/profile$
Disallow: /*/user/password/change$
Disallow: /*/user/password/set$
Disallow: /*/user/feedback/status?type=*
Disallow: /*/user/register/confirm$
Disallow: /*/user/email/change$
Sitemap: http://www.dw.com/sitemap.xml