# All robots will spider the domain # Disallow directory User-agent: * Disallow: banner Disallow: /cgi-bin* User-agent: * Disallow: logos User-agent: * Disallow: css User-agent: * Disallow: images