robots.txt details

379d3cd74ca4ebf07486f0b79d7eb2d8

saved: | size: 820kb | checksum: 379d3cd74ca4ebf07486f0b79d7eb2d8

websites using this robots.txt

content


User-Agent: Yandex
Disallow: /users/
Disallow: /*/users/
Disallow: /accept-gdpr/
Disallow: /*/accept-gdpr/
Disallow: /getVideos/
Disallow: /*/getVideos/
Disallow: /pay/basket/
Disallow: /*/pay/basket/
Disallow: /export
Disallow: */news_like/
Disallow: /format=
Disallow: /redirect.php
Disallow: /site/trial
Clean-param: b_lang&color&search&size&id&lang&encoding&format&type&from&query

User-Agent: *
Disallow: /users/
Disallow: /*/users/
Disallow: /accept-gdpr/
Disallow: /*/accept-gdpr/
Disallow: /getVideos/
Disallow: /*/getVideos/
Disallow: /pay/basket/
Disallow: /*/pay/basket/
Disallow: /export
Disallow: */news_like/
Disallow: /format=
Disallow: /redirect.php
Disallow: /site/trial
Sitemap: https://serpstat.com/sitemap.xml
Sitemap: https://serpstat.com/ru/sitemap.xml
Sitemap: https://serpstat.com/de/sitemap.xml