User-agent: * Allow: / # Allow all crawlers to access the site for proper social media sharing # This enables Facebook, Twitter, LinkedIn and other platforms to crawl # og:image tags and other meta data for rich link previews # Specifically allow social media crawlers User-agent: facebookexternalhit Allow: / User-agent: Twitterbot Allow: / User-agent: LinkedInBot Allow: / User-agent: WhatsApp Allow: / Sitemap: /sitemap.xml