robots.txt details

saved: size: 724 kb md5 checksum: 9abaa51e4697b6c3ac60d515032a93a1

websites using this robots.txt

content


User-agent: *
Allow: */markets/*css
Allow: */markets/*js
Allow: */imagesandvideo/
Allow: /es-es/blog/error*
Disallow: */markets/
Disallow: /na/error
Disallow: /us/search
Disallow: /ca/search
Disallow: /na/search
Disallow: /NoRobots 
Disallow: /*/sitecore
Disallow: /*/sitecore modules
Disallow: /*/search
Disallow: /*/error
Disallow: /*/search-results-page
Disallow: /*/test-pages
Disallow: /en-gb/search-results/
Disallow: /en-us/search-results/
Disallow: /en-ie/search-results/
Disallow: /fr-fr/search-results/
Disallow: /de-de/search-results/
Disallow: /es-es/resultados-de-búsqueda/
Disallow: *?year=*
Disallow: *?month=* 
Disallow: *&year=*
Disallow: *&month=*
User-agent: BUbiNG
Disallow: /