Pre-rendering for BigCommerce through Cloudflare
How BigCommerce pre-rendering works#
BigCommerce manages store hostnames through its own Cloudflare account (Cloudflare for SaaS). With BigCommerce's default DNS instructions, requests are handed straight to BigCommerce and never reach your Worker. A proxied CNAME in your own Cloudflare zone puts the Worker back in the path.
Crawler GET requests for HTML receive the rendered snapshot from Encited. Browser visits, assets, and any failed render calls continue through Cloudflare to BigCommerce unchanged.
Prerequisites#
- An Encited account and API key (Settings → API Keys).
- Your store's custom domain with DNS managed in a Cloudflare account (any plan).
- Your store's domain already connected in BigCommerce. The apex, www, and subdomains all work.
Set up pre-rendering for BigCommerce#
1. Point your DNS at BigCommerce with a proxied CNAME#
In your Cloudflare zone, every hostname your store runs on (the apex, www, or a subdomain) must be a CNAME to shops.mybigcommerce.com, set to Proxied (orange cloud). Cloudflare then routes traffic through your zone first, so your Worker runs before BigCommerce serves the page.
If your store runs on the apex domain
BigCommerce asks for an A record on the apex (for example 192.200.160.15). Cloudflare sends an A record's traffic to BigCommerce before your Worker runs, even when the record is proxied. Replace it with a CNAME:
- Note the current A record, so you can restore it.
- Delete the A record on the apex.
- Add a CNAME with name
@, targetshops.mybigcommerce.com, and proxy status Proxied.
Cloudflare allows a CNAME on the apex on every plan. Your store stays on the apex, and nothing changes in BigCommerce. The apex can be unreachable for a few seconds between steps 2 and 3. If the apex shows a Cloudflare error page after the change, restore the A record and contact BigCommerce support.
2. Create a new Worker#
Open Cloudflare dashboard → choose a "Hello World" Worker → Deploy → Edit Code
3. Paste the snippet below into the Worker editor#
encited
// encited.js (Cloudflare Worker)
export default {
async fetch(req, env) {
// Only handle public GET navigations
if (req.method !== 'GET') return fetch(req);
// Treat missing/empty Accept and bare '*/*' as HTML so crawler tests
// (curl without -H, default fetch) still route through prerender.
// Asset requests from browsers send specific Accept (e.g. 'text/css,*/*;q=0.1')
// so they won't match.
const accept = (req.headers.get('accept') || '').trim();
const isHtmlRequest = !accept || accept === '*/*' || accept.includes('text/html');
if (!isHtmlRequest) return fetch(req);
const headers = new Headers();
// Add LOVABLEHTML_API_KEY as a secret: Worker -> Settings -> Variables and Secrets.
headers.set('x-lovablehtml-api-key', env.LOVABLEHTML_API_KEY);
headers.set('accept', 'text/html');
const forward = [
'accept-language',
'sec-fetch-mode',
'sec-fetch-site',
'sec-fetch-dest',
'sec-fetch-user',
'upgrade-insecure-requests',
'referer',
'user-agent',
];
for (const name of forward) {
const v = req.headers.get(name);
if (v) headers.set(name, v);
}
// Bot requests only: Encited checks the IP against the crawler's published
// ranges. Browsers send Sec-Fetch-Mode, so visitor IPs are never sent.
const clientIp = req.headers.get('cf-connecting-ip');
if (!req.headers.get('sec-fetch-mode') && clientIp) {
headers.set('x-encited-client-ip', clientIp);
}
try {
const r = await fetch(
'https://encited.com/api/prerender/render?url=' + encodeURIComponent(req.url),
{ headers, redirect: 'manual' },
);
// 301 = configured redirect rule matched - forward to client
if (r.status === 301) {
const loc = r.headers.get('location');
if (loc) {
return new Response(null, {
status: 301,
headers: { location: loc, 'cache-control': 'no-store' },
});
}
}
// 304 = not pre-rendered, pass through to origin
if (r.status === 304) {
return fetch(req);
}
if (r.status === 200 && (r.headers.get('content-type') || '').includes('text/html')) {
const responseHeaders = new Headers(r.headers);
for (const name of ['content-encoding', 'content-length', 'transfer-encoding', 'connection', 'keep-alive']) {
responseHeaders.delete(name);
}
responseHeaders.set('content-type', 'text/html; charset=utf-8');
return new Response(r.body, { status: 200, headers: responseHeaders });
}
} catch {
// Prerender unreachable → fall through so visitors still get the site
}
return fetch(req);
},
};
4. Add a route to your Worker#
Go to your Worker → Settings → Domains & Routes → Add Route → enter *yourdomain.com/*. It covers the apex and www.
5. Deploy the Worker#
It can take a couple of minutes to start working.
Common mistakes
- DNS record on the gray cloud. Routes only fire on proxied traffic. In DNS → Records, the CNAME record for each store hostname must show the orange cloud (Proxied), not gray (DNS only).
- An A record on the apex. Proxied or not, an A record sends apex traffic to BigCommerce before your Worker runs. Use the apex CNAME from step 1.
- Failure mode left on the default. Set the route's Failure mode to Fail open (proceed) so a Worker error sends requests straight to your origin instead of failing.
- Bot Fight Mode blocking crawlers. Bot Fight Mode and AI crawler blocking (Security → Bots) run before your Worker, so a blocked crawler never reaches it. Allow the crawlers you want pre-rendered.
Test the integration#
1. Send a crawler request
curl -sS -D - -o /dev/null \
-A "Googlebot" \
-H "Accept: text/html" \
"https://your-domain.com/"
Look for a successful HTML response and the x-lovablehtml-render-cache header.
2. Confirm browser passthrough
curl -sS -D - -o /dev/null \
-A "Mozilla/5.0" \
-H "Accept: text/html" \
-H "Accept-Language: en-US" \
-H "Sec-Fetch-Mode: navigate" \
-H "Sec-Fetch-Dest: document" \
-H "Upgrade-Insecure-Requests: 1" \
"https://your-domain.com/"
This request should come back from BigCommerce without an Encited render-cache header.
Common errors#
The render-cache header never appears
The DNS record is usually still an A record or not proxied, so traffic skips your zone. The store hostname must be a CNAME to shops.mybigcommerce.com set to Proxied (orange cloud).
The header appears on www but not on the apex
The apex is still an A record. Replace it with a proxied CNAME to shops.mybigcommerce.com, as in step 1.
Crawler requests return errors instead of rendered HTML
Confirm the Worker has a secret named LOVABLEHTML_API_KEY with a valid API key from your Encited dashboard, then redeploy the Worker.
Request and security behavior#
- Only crawler GET requests for public HTML pages are answered with pre-rendered snapshots.
- Along with the public page URL, only the API key and crawler-classification headers are sent to Encited.
- For bot requests (no Sec-Fetch-Mode header), the visitor IP is also sent, so Encited can check the crawler against its published IP ranges. Browser visitors' IPs are never sent.
- Cookie and Authorization headers are never forwarded to Encited.
- If Encited is unavailable or does not return rendered HTML, the request continues to BigCommerce unchanged.
If your zone runs bot protection or rate limiting, those rules block us before the Worker route helps. Set a render token and add the Cloudflare rule so renders and audit crawls get through.
Common questions#
Why doesn't the standard Cloudflare setup work for BigCommerce?#
BigCommerce uses Cloudflare for SaaS, so with its default DNS instructions Cloudflare hands requests directly to BigCommerce and your Worker never runs even with a route attached. The proxied CNAME routes traffic through your own zone first.
Can my store stay on the apex domain?#
Yes. Replace BigCommerce's apex A record with a proxied CNAME to shops.mybigcommerce.com (step 1). The store, its primary domain in BigCommerce, and checkout stay the same.
Does this work on the free Cloudflare plan?#
Yes. The proxied CNAME plus a Worker route works on any Cloudflare plan.
Does this affect checkout?#
No. Only crawler requests for HTML pages get pre-rendered snapshots. All browser traffic continues to BigCommerce unchanged.
