robots.txt details

f3858bd21a141c084af05d256dc6557c

saved: | size: 314kb | checksum: f3858bd21a141c084af05d256dc6557c

websites using this robots.txt

content


Sitemap: https://twist.com/sitemap.xml
User-agent: *
Disallow: /index.html
Disallow: /a/
Disallow: /j/
Disallow: /_j
Disallow: /admin
Disallow: /join
Disallow: /joined
Disallow: /token_redirect
Disallow: /google_register_redirect
Disallow: /google_redirect
Disallow: /google_register
Disallow: /api
Disallow: /app