# need a robots.txt checker? # get it on https://chrome.google.com/webstore/detail/robotstxt-viewer/agckgmkiigllflmahknlkhhhhmchodcb User-agent: *