--- title: "Facebook Crawler Simulator - Test Meta OG Crawler | Free Tool" description: "Simulate how Facebook, Instagram, and Threads crawl your website for Open Graph previews. Test your meta tags and social sharing." lang: en json-ld: --- [![Encited logo](/brand/logo.svg)](/) - Features - Resources [Pricing](/pricing)Login[Contact Sales](/contact-sales)Get started free Get started free [All Crawler Simulators](/free-tools/crawler-simulator) ![Facebook Crawler](/crawler-logos/meta.svg) CRAWLER SIMULATOR # Facebook Crawler Simulator Test how Meta's crawler fetches your pages for link previews on Facebook, Instagram, and Threads. Optimize your Open Graph tags. SIMULATE ## Test your site with Facebook Crawler Enter your URL to see how Facebook Crawler views your site. ![meta](/crawler-logos/meta.svg)Meta-ExternalFetcher Simulate Meta-ExternalFetcher OVERVIEW ## What is Facebook Crawler? Facebook's crawler (facebookexternalhit) fetches your web pages to generate link previews when content is shared on Facebook, Instagram, Threads, and Messenger. It reads Open Graph meta tags to display titles, descriptions, and images. The Meta-ExternalAgent crawler is also used for content understanding across Meta's platforms. WHY ALLOW IT ## Why allow Facebook Crawler? Generate rich link previews on Facebook Display proper thumbnails on Instagram link stickers Show accurate previews in Messenger Optimize sharing on Threads Improve click-through rates on shared links Control how your content appears when shared ROBOTS.TXT ## Facebook Crawler robots.txt configuration Control how Facebook Crawler accesses your website using robots.txt directives. Add these rules to your robots.txt file at the root of your domain. ### Allow Facebook Crawler \# Allow Facebook/Meta crawlers User-agent: facebookexternalhit Allow: / User-agent: Meta-ExternalAgent Allow: / User-agent: FacebookBot Allow: / ### Block Facebook Crawler \# Block Facebook/Meta crawlers (not recommended) User-agent: facebookexternalhit Disallow: / User-agent: Meta-ExternalAgent Disallow: / **User-Agent String:** `facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext)` ## Facebook Crawler FAQ ### Why aren't my Open Graph images showing on Facebook? ### How do I debug Facebook link previews? ### What Open Graph tags are required? ### Does the Facebook crawler execute JavaScript? ### How often does Facebook re-crawl my pages? ## Related Crawler Simulators [ ![LinkedInBot](/crawler-logos/linkedin.svg) LinkedInBot Simulator ](/free-tools/crawler-simulator/linkedinbot-simulator)[ ![Bytespider](/crawler-logos/bytedance.jpeg) Bytespider Simulator ](/free-tools/crawler-simulator/bytespider-simulator)[ ![Googlebot](/crawler-logos/google-search.svg) Googlebot Simulator ](/free-tools/crawler-simulator/googlebot-simulator)[ ![Bingbot](/crawler-logos/bing.svg) Bingbot Simulator ](/free-tools/crawler-simulator/bingbot-simulator) ## More Free SEO Tools Continue auditing your site with these companion tools. [ SEO & AEO Audit Full technical SEO and AI visibility audit ](/free-tools/seo-audit)[ Robots.txt Analyzer Check which crawlers are allowed or blocked ](/free-tools/robots-txt-analyzer)[ OG Image Previewer Preview social media link cards ](/free-tools/og-image-previewer)[ Meta Tag Audit Audit meta tags and generate a fix prompt ](/free-tools/meta-tag-audit)[ AI Crawl Checker See which AI engines can crawl, reach, and read your site ](/free-tools/ai-crawl-checker) ## Related Guides Dive deeper with these step-by-step guides and tutorials. [Get Indexed by ChatGPT, Perplexity & AI Search ](/blog/how-to-get-pages-indexed-by-openai-chatgpt)[Is Lovable SEO Friendly? A Practical Guide ](/blog/is-lovable-seo-friendly)[What Is Pre-rendering for SPAs? ](/docs/guides/what-is-prerendering-for-spas)[DIY Lovable SEO Tips (No Code Required) ](/blog/diy-lovable-seo-tips) GET STARTED ## Make your site crawlable JavaScript sites often have indexing issues. Encited pre-renders your SPA into crawler-friendly HTML so Facebook Crawler and other bots can read your content. Make your pages crawlable[All crawlers](/free-tools/crawler-simulator) ![Encited logo](/brand/logo.svg) Follow us: [](https://www.facebook.com/lovablehtml/)[](https://linkedin.com/company/lovablehtml) [LaunchFast.shop](https://launchfast.shop) product ❤︎ ### Product - [Track Brand Visibility](/ai-visibility-tracker) - [Create Content](/create-content) - [Get Indexed Faster](/get-indexed-faster) - [Site Audit](/site-audit) - [Pre-rendering](/prerender) - [Encited MCP](/seo-mcp) ### Free SEO Tools - [Free SEO & AEO Audit](/free-tools/seo-audit) - [Crawler Simulator](/free-tools/crawler-simulator) - [Robots.txt Analyzer](/free-tools/robots-txt-analyzer) - [OG Image Previewer](/free-tools/og-image-previewer) - [Meta Tag Audit](/free-tools/meta-tag-audit) ### Resources - [Blog](/blog) - [Guides and API docs](/docs) - [Prerender.io Alternative](/prerender-io-alternative) ### Company - [Affiliate Program 30% ](/become-partner) - [About](/about) - [Media Kit](/media-kit) - [Contact](mailto:team@encited.com) ### Legal - [Privacy Policy](/privacy) - [Terms of Service](/terms) ![Avatar](https://replymaven.com/api/uploads/Su6Q0nK63iZW0ZFJBRNWpmRuppVDLuab/98df5262-f992-45fa-a750-00a6c919baf9.png) How can we help? Get instant answers to your questions or leave a message for an engineer will reach out Ask AI about Encited [See our docs ](https://lovablehtml.com/docs) Contact support Leave a message We'll get back to you soon Your name\* Your email\* Your message\* Send message ![Avatar](https://replymaven.com/api/uploads/Su6Q0nK63iZW0ZFJBRNWpmRuppVDLuab/98df5262-f992-45fa-a750-00a6c919baf9.png) Ask AI about Encited Product questions, troubleshooting and Thinking Drop an image to attach Powered by [ReplyMaven](https://replymaven.com)