robots.txt details

2d4595d63c7c0988fe6c2b101b746eb4

saved: | size: 250kb | checksum: 2d4595d63c7c0988fe6c2b101b746eb4

websites using this robots.txt

content


# Make changes for all web spiders: check https://support.microsoft.com/en-us/help/217103/how-to-write-a-robots-txt-file
# Deny All
User-agent: gsa-crawler-gta (Enterprise; T4-L8ZFC35N48NCN; jenna.tollerson@gta.ga.gov)
#Disallow: *
User-agent: *