robots.txt details

saved: size: 578 kb md5 checksum: 9fbcf0962ae4357b5dffeaa3aabe9d72

websites using this robots.txt

content


User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php

# bad robots
User-agent: CopyRightCheck
User-agent: EmailCollector
User-agent: EmailSiphon
User-agent: EmailWolf
User-agent: HTTrack
User-agent: Microsoft.URL.Control
User-agent: NetAnts
User-agent: Offline Explorer
User-agent: penthesilea
User-agent: SpankBot
User-agent: stress-agent
User-agent: URL_Spider_Pro
User-agent: WebBandit
User-agent: WebCopier
User-agent: WebmasterWorldForumBot
User-agent: WebReaper
User-agent: WebSauger
User-agent: WebStripper
User-agent: WWW-Collector-E