--- title: "Facebook Crawler Simulator & Link Preview Tester" url: https://encited.com/free-tools/crawler-simulator/facebookbot-simulator description: "Simulate a Facebook crawler visit to any URL on your website. Crawl the page and inspect the HTML and Open Graph tags Facebook, Instagram, and Threads get." lang: en --- All Crawler Simulators (https://encited.com/free-tools/crawler-simulator) Image: Facebook Crawler (https://encited.com/crawler-logos/meta.svg) CRAWLER SIMULATOR # Facebook Crawler Simulator & Tester Last updated September 29, 2026 Simulate a Facebook crawler visit to any URL on your website. Crawl the page and inspect the HTML and Open Graph tags Meta reads for link previews. SIMULATE ## Simulate a Facebook Crawler visit Enter any URL on your website to crawl it as Facebook Crawler and inspect the HTML it gets. HOW IT WORKS ## How to use the Facebook Crawler simulator 1. Step 1 ### Enter a URL Paste the full URL of any page on your website, such as a product page, a blog post, or the home page. 2. Step 2 ### Select the Facebook Crawler user agent The tester sends the request with the Facebook Crawler user-agent string, so your server answers the way it answers a real Facebook Crawler visit. 3. Step 3 ### Run the crawl The simulator requests the page as Facebook Crawler and follows redirects, the same way the crawler does. 4. Step 4 ### Inspect the HTML Check the status code, redirects, response headers, raw HTML, word count, and Open Graph tags Facebook Crawler gets. If your main content is missing from the HTML, Facebook Crawler cannot read it. OVERVIEW ## What is Facebook Crawler? Facebook's crawler (facebookexternalhit) fetches your web pages to generate link previews when content is shared on Facebook, Instagram, Threads, and Messenger. It reads Open Graph meta tags to display titles, descriptions, and images. The Meta-ExternalAgent crawler is also used for content understanding across Meta's platforms. WHY ALLOW IT ## Why allow Facebook Crawler? Generate rich link previews on Facebook Display proper thumbnails on Instagram link stickers Show accurate previews in Messenger Optimize sharing on Threads Improve click-through rates on shared links Control how your content appears when shared ROBOTS.TXT ## Facebook Crawler robots.txt configuration Control how Facebook Crawler crawls your website using robots.txt directives. Add these rules to your robots.txt file at the root of your domain, then run the simulator again on the same URL to confirm the change. ### Allow Facebook Crawler \# Allow Facebook/Meta crawlers User-agent: facebookexternalhit Allow: / User-agent: Meta-ExternalAgent Allow: / User-agent: FacebookBot Allow: / ### Block Facebook Crawler \# Block Facebook/Meta crawlers (not recommended) User-agent: facebookexternalhit Disallow: / User-agent: Meta-ExternalAgent Disallow: / **User-Agent String:** `facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext)` ## Facebook Crawler simulator FAQ ### How do I simulate a Facebook Crawler visit to my website? ### Why aren't my Open Graph images showing on Facebook? ### How do I debug Facebook link previews? ### What Open Graph tags are required? ### Does the Facebook crawler execute JavaScript? ### How often does Facebook re-crawl my pages? ## Related Crawler Simulators LinkedInBot Simulator https://encited.com/free-tools/crawler-simulator/linkedinbot-simulator Bytespider Simulator https://encited.com/free-tools/crawler-simulator/bytespider-simulator Googlebot Simulator https://encited.com/free-tools/crawler-simulator/googlebot-simulator Bingbot Simulator https://encited.com/free-tools/crawler-simulator/bingbot-simulator ## More Free SEO Tools Continue auditing your site with these companion tools. SEO Audit 30 checks for crawlability, SEO, and AI readiness https://encited.com/free-tools/seo-audit Crawler Simulator See what 100+ search and AI bots get from your page https://encited.com/free-tools/crawler-simulator Googlebot Simulator Fetch your page as Googlebot Smartphone or Desktop https://encited.com/free-tools/crawler-simulator/googlebot-simulator Robots.txt Analyzer Check which crawlers are allowed or blocked https://encited.com/free-tools/robots-txt-analyzer OG Image Previewer Preview social media link cards https://encited.com/free-tools/og-image-previewer Meta Tag Audit Audit meta tags and generate a fix prompt https://encited.com/free-tools/meta-tag-audit AI Crawler Checker Check if ChatGPT, Claude, and Perplexity can read your site https://encited.com/free-tools/ai-crawl-checker ## Related Guides Dive deeper with these step-by-step guides and tutorials. Get Indexed by ChatGPT, Perplexity & AI Search: https://encited.com/blog/how-to-get-pages-indexed-by-openai-chatgpt Is Lovable SEO Friendly? A Practical Guide: https://encited.com/blog/is-lovable-seo-friendly What Is Pre-rendering for SPAs?: https://encited.com/docs/pre-rendering/what-pre-rendering-gets-you Fix Lovable SEO: The Complete 2026 Guide: https://encited.com/blog/fix-lovable-seo GET STARTED ## Make your site crawlable JavaScript sites often have indexing issues. Encited pre-renders your SPA into crawler-friendly HTML so Facebook Crawler and other bots can read your content. All crawlers: https://encited.com/free-tools/crawler-simulator Image: Avatar (https://replymaven.com/api/uploads/Su6Q0nK63iZW0ZFJBRNWpmRuppVDLuab/98df5262-f992-45fa-a750-00a6c919baf9.png) How can we help? Get instant answers to your questions or leave a message for an engineer will reach out Ask AI about Encited See our docs (https://lovablehtml.com/docs) Contact support Leave a message We'll get back to you soon Ask AI about Encited Product questions, troubleshooting and Thinking Image: Preview Drop an image to attach Powered by ReplyMaven (https://replymaven.com/) ## Structured data ```json [ { "@context": "https://schema.org", "@type": "FAQPage", "mainEntity": [ { "@type": "Question", "name": "How do I simulate a Facebook Crawler visit to my website?", "acceptedAnswer": { "@type": "Answer", "text": "Enter any URL from your website in the tester above and run the crawl. The simulator requests the page with the Facebook Crawler user-agent string and shows the status code, response headers, and raw HTML it gets. Inspect the HTML to confirm your main content, title, and meta tags are there before any JavaScript runs." } }, { "@type": "Question", "name": "Why aren't my Open Graph images showing on Facebook?", "acceptedAnswer": { "@type": "Answer", "text": "Common issues: 1) Image too small (minimum 200x200, recommended 1200x630), 2) Image URL not accessible to crawler, 3) Missing og:image tag, 4) Caching issues - use Facebook's Sharing Debugger to refresh. Our simulator helps verify the crawler can access your page." } }, { "@type": "Question", "name": "How do I debug Facebook link previews?", "acceptedAnswer": { "@type": "Answer", "text": "Use Facebook's Sharing Debugger (developers.facebook.com/tools/debug/) to see what Facebook sees, clear cache, and fetch new scrape information. Our crawler simulator shows you the raw HTML the crawler receives." } }, { "@type": "Question", "name": "What Open Graph tags are required?", "acceptedAnswer": { "@type": "Answer", "text": "Essential tags: og:title, og:description, og:image, og:url. Recommended: og:type, og:site_name, og:image:width, og:image:height. For articles: article:published_time, article:author." } }, { "@type": "Question", "name": "Does the Facebook crawler execute JavaScript?", "acceptedAnswer": { "@type": "Answer", "text": "No, facebookexternalhit fetches raw HTML without JavaScript execution. Open Graph tags must be in your server-rendered HTML. For JavaScript apps, use SSR or pre-rendering to include OG tags." } }, { "@type": "Question", "name": "How often does Facebook re-crawl my pages?", "acceptedAnswer": { "@type": "Answer", "text": "Facebook caches link previews for about 30 days. To force a refresh, use the Sharing Debugger's 'Scrape Again' button. Set og:updated_time to hint that content has changed." } } ] }, { "@context": "https://schema.org", "@type": "WebPage", "name": "Facebook Crawler Simulator & Tester", "url": "https://encited.com/free-tools/crawler-simulator/facebookbot-simulator", "dateModified": "2026-09-29" } ] ```