robots.txt details

saved: size: 837 kb md5 checksum: 53c6e40bfe36f75e2763968f492166fc

websites using this robots.txt

content


User-agent: Googlebot
User-agent: Applebot
User-agent: Bingbot
User-agent: DuckDuckBot
User-agent: Naverbot
User-agent: Twitterbot
User-agent: Yandex
Allow: /

User-agent: Baiduspider
User-agent: 360Spider
User-agent: Yisouspider
User-agent: Sogouspider
Disallow: /

User-agent: *
Allow: /trending
Allow: /discover
Allow: /about
Allow: /legal
Allow: /safety
Allow: /forgood
Allow: /community-guidelines
Allow: /tag
Allow: /music
Allow: /embed
Allow: /share
Allow: /amp
Sitemap: https://www.tiktok.com/tos/node/sitemaps/sitemap.xml
Sitemap: https://www.tiktok.com/tos/node/sitemaps/sitemap_tag_jpagency_index_20200509_-1553821641.xml
Sitemap: https://www.tiktok.com/tos/node/sitemaps/sitemap_tag_jpagency_index_20200525_-1553821583.xml
Sitemap: https://www.tiktok.com/tos/node/sitemaps/sitemap_tag_jpagency_index_20200615_-1553820653.xml