User-agent: * Allow: / User-agent: AhrefsBot Disallow: / User-Agent: SputnikBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: SemrushBot-SA Disallow: / User-agent: MJ12bot Disallow: / User-agent: linkdexbot Disallow: / User-agent: dotbot Disallow: / User-agent: LinkpadBot Disallow: / User-agent: TurnitinBot Disallow: / User-agent: SiteExplorer Disallow: / User-agent: SMTBot Disallow: / User-agent: CrazyWebCrawler-Spider Disallow: / User-agent: BacklinkCrawler Disallow: / User-agent: Alexabot Disallow: / User-agent: MegaIndex.ru/2.0 Disallow: / User-agent: MegaIndex.ru Disallow: / User-agent: linkdexbot/2.0 Disallow: / User-agent: linkdexbot/2.1 Disallow: / User-agent: linkdexbot/2.2 Disallow: / User-agent: ChangeDetection Disallow: / User-agent: AhrefsBot/5.1 Disallow: / User-agent: AhrefsBot/5.2 Disallow: / User-agent: AhrefsBot/1.0 Disallow: / User-agent: AhrefsBot/2.0 Disallow: / User-agent: AhrefsBot/3.0 Disallow: / User-agent: AhrefsBot/4.0 Disallow: / User-agent: AhrefsBot/5.0 Disallow: / User-agent: AhrefsBot/3.1 Disallow: / User-agent: MJ12bot/v1.4.3 Disallow: / User-agent: MJ12bot/v1.4.0 Disallow: / User-agent: MJ12bot/v1.2.4 Disallow: / User-agent: MJ12bot/v1.2.3 Disallow: / User-agent: MJ12bot/v1.0.8 Disallow: / User-agent: MJ12bot/v1.0.7 Disallow: / User-agent: MJ12bot/v1.0.6 Disallow: / User-agent: MJ12bot/v1.0.5 Disallow: / User-agent: MJ12bot/v1.4.5 Disallow: / User-agent: MJ12bot/v1.4.6 Disallow: / User-agent: MJ12bot/v1.4.7 Disallow: / User-agent: MJ12bot/v1.4.8 Disallow: /