User-agent: * Allow: / Disallow: /search Disallow: /login User-agent: Slurp Disallow: / User-agent: Yeti Disallow: /