robots.txt viewer

crackets.com.mx @ 2018-12-06 20:00:21


website: https://crackets.com.mx
robots.txt: crackets.com.mx/robots.txt

/robots.txt (78B)

# www.robotstxt.org/

# Allow crawling of all content
User-agent: *
Disallow: