robots.txt details

saved: size: 373 kb md5 checksum: 5c07165c102b02d9cb7615cd0337f290

websites using this robots.txt

content


Sitemap: http://www.penarthtimes.co.uk/sitemap.xml
User-agent: *
Disallow: /__siren/
Disallow: /search/*
Disallow: /soldpricesearch/*
Disallow: /announcements/public_notices/download/*

User-agent: Googlebot-News
Disallow: /advertise/
Disallow: /advertising/
Disallow: /li/
Disallow: /mart/
Disallow: /trade_directory/
Disallow: /dating/
Disallow: /homes/
Disallow: /jobs/