Sitemap: http://www.sarniathisweek.com/news-sitemap.xml User-agent: * Disallow: /?s= Disallow: /search Disallow: /3081/ Disallow: /*?preview_id=* User-agent: TurnitinBot Disallow: /?s= Disallow: /search Disallow: /3081/ Crawl-delay: 1 User-agent: Googlebot-News Disallow: /category/sponsored/ Disallow: /sponsored/ User-Agent: omgilibot Disallow: / User-Agent: omgili Disallow: / User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php # Sitemap archive Sitemap: https://www.sarniathisweek.com/sitemap.xml