robots.txt details

ae61e481195de0bb93172936f2e73c61

saved: | size: 578kb | checksum: ae61e481195de0bb93172936f2e73c61

websites using this robots.txt

content


User-agent: Googlebot
User-agent: Applebot
User-agent: Bingbot
User-agent: DuckDuckBot
User-agent: Naverbot
User-agent: Twitterbot
User-agent: Yandex
Allow: /

User-agent: Baiduspider
User-agent: 360Spider
User-agent: Yisouspider
User-agent: Sogouspider
Disallow: /

User-agent: *
Allow: /tag
Allow: /music
Allow: /share
Allow: /h5
Allow: /i18n
Allow: /v
Allow: /rewind
Allow: /activity
Allow: /embed
Sitemap: https://www.tiktok.com/sitemap.xml
Sitemap: https://www.tiktok.com/light/node/sitemaps/sitemap.xml
Sitemap: https://www.tiktok.com/light/node/sitemaps/sitemap_lang.xml