User-agent: Twitterbot Disallow: User-agent: * Disallow: /watch/ Disallow: /users/ Sitemap: https://api.redgifs.com/sitemap.xml