robots.txt details

1ef147c7c7a71dded477eb5b53e052ec

saved: | size: 384kb | checksum: 1ef147c7c7a71dded477eb5b53e052ec

websites using this robots.txt

content


User-agent: *
Disallow: */print
Disallow: */authors/*/1*
Disallow: */authors/*/2*
Disallow: */authors/*/3*
Disallow: */authors/*/4*
Disallow: */authors/*/5*
Disallow: */authors/*/6*
Disallow: */authors/*/7*
Disallow: */authors/*/8*
Disallow: */authors/*/9*
Disallow: /newspaper/*/20*
Disallow: /archive/*

# test tool
# https://www.google.com/webmasters/tools/ (Crawl > Blocked URLs)