robots.txt viewer

jsdo.it @ 2019-02-09 14:28:52


website: http://jsdo.it
robots.txt: jsdo.it/robots.txt

/robots.txt (120B)

User-agent: *
Allow: /
Disallow: /search
Disallow: /login

User-agent: Slurp
Disallow: /

User-agent: Yeti
Disallow: /