# www.robotstxt.org/ # Allow crawling of all content User-agent: * Disallow: /go/ Disallow: /ping/ Disallow: /_data/ Disallow: /_data-cached/ Disallow: /*?item=* Disallow: /*&item=* Sitemap: https://www.everysize.com/sitemap.xml User-agent: seekbot Disallow: /