robots.txt details

saved: size: 299 kb md5 checksum: 9d0e153143c38e71f61e9b7efb84cf7b

websites using this robots.txt

content


User-agent: *
Disallow: /ajax/*
Disallow: /*ajax=1*
Disallow: /my-profile*
Disallow: /checkout*
Disallow: /news.aspx/*
Disallow: /*?p=*
Disallow: /*&p=*
Disallow: /*&prg=*
Disallow: /technology*
Disallow: /*?q=*
Disallow: /*&q=*
Disallow: /*user=*
Disallow: /*link.aspx*
Crawl-delay:10