robots.txt details

saved: size: 264 kb md5 checksum: c19ab042d06e0d22f752ab70c609682c

websites using this robots.txt

content


User-agent: *
Disallow: /internalapi/
Disallow: /projects/embed/
Disallow: /cloudmonitor/
Disallow: /varserver/
Disallow: /tags/
Disallow: /site-api/
Disallow: /api/
Disallow: /scratchr2/static/
Disallow: /scratch_1.4/

User-agent: Baiduspider
Disallow: /studios/