robots.txt details

saved: size: 255 kb md5 checksum: 7a53d9da50a236c3d5e29a6eb2d680c5

websites using this robots.txt

content


User-agent: *
Disallow: /*q=
Disallow: /users/*?
Disallow: /join/*?
Disallow: /morelikethis/
Disallow: /download/
Disallow: /checkout/
Disallow: /global/
Disallow: /api/
Disallow: /critiques/
 
Sitemap: http://sitemaps.deviantart.net/sitemap-index.xml.gz