User-agent: facebookexternalhit Allow: / User-agent: Googlebot User-agent: Googlebot-Image User-agent: Bingbot User-agent: ia_archiver Crawl-delay: 5 Disallow: User-agent: * Disallow: /