robots.txt details

saved: size: 381 kb md5 checksum: 0f6d2a416dc55469f58368e47a58b945

websites using this robots.txt

content


Sitemap: https://www.peterboroughmatters.co.uk/sitemap.xml
User-agent: *
Disallow: /__siren/
Disallow: /search/*
Disallow: /soldpricesearch/*
Disallow: /announcements/public_notices/download/*

User-agent: Googlebot-News
Disallow: /advertise/
Disallow: /advertising/
Disallow: /li/
Disallow: /mart/
Disallow: /trade_directory/
Disallow: /dating/
Disallow: /homes/
Disallow: /jobs/