robots.txt details

saved: size: 344 kb md5 checksum: 3ba32d591454814064e287e9c5885260

websites using this robots.txt

content


User-agent: *

Disallow: /internal-api/

Sitemap: https://www.southyorkshiretimes.co.uk/sitemaps/googlenews
Sitemap: https://www.southyorkshiretimes.co.uk/sitemaps/sitemap.xml
Sitemap: https://www.southyorkshiretimes.co.uk/sitemaps/videoarticles/googlenews.xml
Sitemap: https://www.southyorkshiretimes.co.uk/sitemaps/videoarticles/sitemap.xml