robots.txt details

saved: size: 267 kb md5 checksum: d6a9affcc8ba442009e6e571493c58d5

websites using this robots.txt

content


User-agent: *
Crawl-delay: 0.5
Disallow: /errors/
Disallow: /admin/
Disallow: /edit/
Disallow: /detail/
Disallow: /set-status/
Disallow: /adjust-popularity/
Disallow: /extension-query/
Disallow: /extension-info/
Disallow: /download-extension/
Disallow: /update-info/