robots.txt details

d11bfcdbf6b4ad3f0cdffa66aee28c74

saved: | size: 236kb | checksum: d11bfcdbf6b4ad3f0cdffa66aee28c74

websites using this robots.txt

content


User-agent: ia_archiver
Disallow: /

User-agent: *
Disallow: /photoblog/
Disallow: /photoblog/*
Disallow: /pics/
Disallow: /pics*/
Disallow: /pics/*
Disallow: /pics/*/
Disallow: /photo/
Disallow: /photo*/
Disallow: /dl/*