robots.txt details

saved: size: 364 kb md5 checksum: d53cf4f4ffef76cfe6308e1a3e1f1440

websites using this robots.txt

content


User-agent: *
Allow: /
Disallow: /contact.php
Disallow: /inbox/
Disallow: /levels/
Disallow: /levels/extras/userpass.txt
Disallow: /users/
Disallow: /ctf/8/php/*

User-agent: Mediapartners-Google
Disallow:

User-agent: Yahoo Pipes 1.0
Disallow: /

User-agent: KSCrawler
Disallow: /

User-agent: Spinn3r
Disallow: /

Sitemap: https://www.hackthis.co.uk/sitemap.xml