User-agent: Googlebot User-agent: Bingbot User-agent: Slurp User-agent: Baiduspider Crawl-delay: 10 Disallow: User-agent: * Disallow: /