# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file # # To ban all spiders from the entire site uncomment the next two lines: User-agent: * Disallow: /offers/new?* Disallow: /login?* Disallow: /feed* Disallow: /cobuyer* Disallow: /for-agents* Disallow: /fixers Disallow: /p/*/comps Disallow: /showings* Sitemap: https://buy.opendoor.com/shared/sitemaps/sitemap.xml.gz Sitemap: https://buy.opendoor.com/shared/otf_sitemaps/sitemap.xml.gz