User-agent: * Sitemap: https://www.standard.net.au/sitemap.xml Sitemap: https://www.standard.net.au/sitemap-news.xml # Agent Specific Disallowed Sections Disallow: /*/ajax/ Disallow: /*/ajax Disallow: /*/internal/ Disallow: /push-worker.js Disallow: /scores-and-draws/ # Agent Specific Disallowed Feeds Disallow: */rss.xml Disallow: */rss-full.xml Disallow: */feed Disallow: */feed/ # IVT recommendation User-agent: PetalBot Disallow: / # Teads recommendation User-agent: grapeshot Disallow: # OpenAI disallowed GPT crawling User-agent: GPTBot Disallow: /