User-agent: ia_archiver Disallow: / User-agent: * Disallow: /photoblog/ Disallow: /photoblog/* Disallow: /pics/ Disallow: /pics*/ Disallow: /pics/* Disallow: /pics/*/ Disallow: /photo/ Disallow: /photo*/ Disallow: /dl/*