User-Agent: * Disallow: Disallow: /api Disallow: /oauth Disallow: /confirm Disallow: /notifications Disallow: /old-browser.html Disallow: /docs/concepts/payments-and-billing/usage-based-pro-plan Disallow: /docs/concepts/projects/sensitive-environment-variables # Allow robots to be able to crawl the OG Image API route and all the subpaths Allow: /api/og/* Sitemap: https://vercel.com/sitemap.xml