Encited logo
PricingTalk to sales
Faceted Navigation SEO: Best Practices, Examples and Google's Guidelines for Ecommerce

Faceted Navigation SEO: Best Practices, Examples and Google's Guidelines for Ecommerce

Oct 16, 2026October 16, 2026·Updated Oct 29, 2026October 29, 2026·by Aki from Encited

Faceted navigation SEO for ecommerce: what faceted navigation is, why filter URLs cause overcrawling, which facets to index, and Google's rules for the rest.

Faceted navigation is the set of filters on a category page: brand, size, color, price, rating. Each filter click can create a new URL, so a store with a few thousand products can expose millions of filter pages to crawlers. Google says faceted navigation is the most common cause of the overcrawling that site owners report to it. Faceted navigation SEO for an ecommerce store is three jobs: give the filter pages people search for clean, linked URLs, keep crawlers out of every other combination, and measure where Googlebot actually spends its requests. It is one part of ecommerce SEO; the rest of the technical work, from canonicals to pagination, is in technical SEO for ecommerce.

TL;DR

  • Faceted navigation lets shoppers combine filters. Each combination can be its own URL, and the count multiplies with every facet.
  • Google calls it "by far the most common source of overcrawl issues". The cost is slower crawling of new products, and index bloat.
  • Index only the combinations people search for, like "red running shoes". Give them static URLs, unique titles and plain links.
  • For the rest, Google recommends a robots.txt disallow or URL fragments. Canonical tags and nofollow work less well over time.
  • Never block a URL in robots.txt and noindex it as well. Google can't see a noindex on a page it can't crawl.
  • Keep one parameter order, and return a 404 for filter combinations with no products.
  • Measure first: Crawl Stats in Search Console, your log files and a full site crawl.

What is faceted navigation?

Faceted navigation lets a visitor narrow a listing by several attributes at once. Each attribute is a facet (brand, color, size) and each facet has values (Nike, red, 10). Pick Nike, red and size 10 on a running shoes category, and the grid shows only the products that match all three.

Plain filtering works on one dimension at a time: a sort order, or a single "in stock" toggle. Faceted search combines independent facets, usually shows a product count next to each value, and updates the other facets as you choose. For SEO the difference matters because facets compound. Every facet you add multiplies the number of possible pages.

Faceted navigation examples and the URLs they create

Most sites with large listings use facets:

  • Amazon: the sidebar on any search or category page, with brand, price, customer reviews and facets that change by department.
  • Booking.com: hotels filtered by price, star rating, review score, distance and facilities.
  • Fashion and footwear stores: size, color, width, brand, material and price on every category.
  • Job boards: location, salary, remote work and seniority.
  • Real estate portals: price, bedrooms, property type and area.
  • Publishers: topic, author and date.

How filters turn into URLs

These faceted navigation examples all record the selected filters in one of four ways, and each one looks different to a crawler:

Where the filter goes Example What a crawler sees
Nowhere, the URL doesn't change /running-shoes/ One page. Filtered views can't be crawled or ranked.
Query parameters /running-shoes/?color=red&size=10 A new URL for every combination
A fragment after # /running-shoes/#color=red The category URL. Google ignores the fragment.
The path /running-shoes/red/size-10/ A new URL for every combination, which looks like a normal page

The count grows fast. Take one category with 6 brands, 10 colors, 15 sizes, 4 widths, 5 price bands and 3 sort orders. If a shopper can pick one value per facet or leave it empty, that's 7 x 11 x 16 x 5 x 6 x 4 = 147,840 URLs for a single category. Let shoppers pick several values per facet and the number passes the millions. If the site writes parameters in the order they were clicked, five filters can also be written 120 different ways, each one a separate URL for the same products.

Why faceted navigation causes SEO problems

Google's December 2024 Crawling December post on faceted navigation says faceted navigation is "by far the most common source of overcrawl issues site owners report to us". Google's faceted navigation documentation names two harms. Crawlers "can't determine whether the URLs are going to be useful without crawling first", so they fetch a very large number of filter URLs before they learn to skip them. And "if crawling is spent on useless URLs, the crawlers have less time to spend on new, useful URLs."

Overcrawling and wasted crawl budget

Google limits how much it crawls on each site. Its crawl budget guide says this mostly matters for sites with 1 million+ unique pages, or 10,000+ pages that change daily. Faceted navigation is how a store with 3,000 products ends up in that group: 40 categories with 100,000 filter URLs each is 4 million crawlable pages. New products, restocks and price changes then wait behind filter pages that nobody will ever search for.

Index bloat and duplicate content

A filter page shares its title, description, intro text and most of its products with the category above it. Google drops many of these as duplicates or files them under "Crawled - currently not indexed". It indexes some anyway, and those are index bloat: pages in Google's index that match no search and compete with the pages you want to rank. /running-shoes/?brand=nike, /running-shoes/nike/ and /brands/nike/?type=running can all end up competing for "nike running shoes".

Split ranking signals

Internal links spread across thousands of variants, so the category and the facet pages that should rank get a smaller share. Shoppers share filtered URLs too, and the links they post point at variants Google may never keep.

Server load

Google's documentation warns that crawling faceted URLs "tends to cost sites large amounts of computing resources due to the sheer amount of URLs and operations needed to render those pages." Every crawl of a filter URL is a database query and a full page build. On a JavaScript storefront it's also a full render.

AI crawlers and other bots crawl facets too

Google's robots.txt example for facets starts with user-agent: Googlebot. Copy it as it is, and Bingbot, GPTBot, ClaudeBot, PerplexityBot and every other crawler keep crawling your filter URLs. Put facet rules in the User-agent: * group.

Check your other groups as well. In Google's words, "Only one group is valid for a particular crawler", and crawlers that follow the robots.txt standard read only the most specific group that matches them. If your file has its own User-agent: GPTBot group, the facet rules in the * group don't apply to GPTBot. Repeat them in that group.

How to audit faceted navigation

Measure before you change anything.

1. Map how your filters build URLs

  1. Apply one filter, then a second, then apply the same two in reverse order. Note whether the filters go into parameters, a fragment or the path, and whether the click order changes the URL.
  2. Inspect a filter in your browser's developer tools. An <a href> element is a link crawlers follow. A <button>, checkbox or <a> with no href is not.
  3. Open a combination with no products and check the status code:
bash
CopyDownload
curl -s -o /dev/null -w "%{http_code}\n" "https://yourstore.com/running-shoes/?color=purple&size=17"
  1. On a filter page, note the canonical tag, the robots meta tag and whether robots.txt blocks the URL.

2. Read Crawl Stats in Search Console

Open Settings, then Crawl stats, then the report. Click HTML under "By file type", then look at the example URLs. If most of them carry filter parameters, that's where Googlebot spends its visits. "By purpose" splits requests into Discovery (URLs Google never crawled before) and Refresh. A high Discovery share on a store whose catalog barely changes usually means Googlebot keeps finding new filter URLs. The report needs a domain property or a URL-prefix property at the root of the site.

3. Check the Page indexing report

If your sitemaps list only canonical URLs, set the filter above the chart to "Unsubmitted pages only" and open "View data about indexed pages". Filter URLs in that list are indexed pages you never asked for. Then, under "Why pages aren't indexed", open "Crawled - currently not indexed", "Duplicate without user-selected canonical" and "Duplicate, Google chose different canonical than user". Filter URLs there were crawled and judged not worth keeping. Each one cost a crawl. The Crawled - currently not indexed guide covers what else lands in that bucket.

4. Count bot hits in your log files

Your server logs list every request. For logs in the common combined format, these two commands show the share of Googlebot requests that went to URLs with a query string, and the parameters crawled most:

bash
CopyDownload
grep "Googlebot" access.log | awk '{ total++; if ($7 ~ /\?/) param++ } END { printf "%d of %d Googlebot hits (%.0f%%) had a query string\n", param, total, 100*param/total }'
grep "Googlebot" access.log | awk '{print $7}' | grep -o '[?&][^=&]*=' | sort | uniq -c | sort -rn | head -20

Anyone can send a Googlebot user agent, so confirm the top IP addresses with a reverse DNS lookup before acting on the numbers. Many stores on hosted platforms or CDNs can't get raw logs at all. If your store runs through Encited, the crawl log lists each request from Googlebot, Bingbot and AI crawlers with the full URL, query string included, plus the status code and what the bot got back. Filter by crawler and you can see how many hits land on filter URLs.

5. Crawl the site like a bot

A site crawl that starts at your homepage and follows internal links shows how many URLs a bot can reach, and leaking facets leave clear symptoms: groups of pages with duplicate titles, duplicate content, and canonical tags that point at another URL. Encited's site audit flags each of these per page with the recommended fix. Compare the number of crawlable URLs with the number of products and categories you actually have.

While you have the data, look for signals that contradict each other: URLs that robots.txt blocks and that also carry noindex, filter URLs in your XML sitemap, canonical tags that point at blocked or noindexed pages, and internal links to URLs you block.

Most of these conflicts involve robots.txt. The robots.txt analyzer lists the rules in each user-agent group of your file and shows whether Googlebot, GPTBot and ClaudeBot are allowed, blocked or partly blocked.

Decide which facet pages should be indexable

A facet page earns a place in the index when people search for it and you have enough products to answer the search. "Red running shoes", "nike running shoes" and "waterproof hiking boots" are real searches: a category plus one attribute. A search with two attributes ("women's red running shoes") sometimes has demand. Size, price range, rating, sort order and stock status almost never do.

Check demand with keyword research on "[attribute] [category]" patterns. In Search Console, open Performance, filter by a category page and look for queries with an attribute in them. A category that already gets impressions for "red" or "leather" queries is telling you which facet pages to build. Drop a page when its product count falls too low to fill a grid.

Facet Searched together with the category? What to do
Brand Often ("nike running shoes") Static page where demand exists
Color Sometimes ("red dress") Static pages for the colors with demand
Material, style, use Sometimes ("leather boots", "trail running shoes") Static pages where demand exists
Gender, age group Often Usually a category already
Size Rarely, apart from cases like "wide fit" Block
Price range Rarely Block. Build an "under $50" page only if it's searched
Sort order, view mode, items per page Never Block
In stock, on sale, rating Never Block

Give indexable facets static, linked URLs

Each facet page you keep should look like a category to Google:

  • A clean URL such as /running-shoes/red/, or a dedicated collection such as /collections/red-running-shoes.
  • A self-referencing canonical tag.
  • Its own title, H1 and meta description, written for the search, such as "Red Running Shoes | Your Store".
  • A short intro and, where it helps shoppers, a block of copy below the product grid.
  • Plain <a href> links from the parent category, the navigation, breadcrumbs and related categories.
  • An entry in your XML sitemap.
  • No robots.txt rule that matches it by accident.

A small allowlist in the code that builds filter links keeps the two kinds of URL apart. Single facets with demand get a static path. Every other state gets parameters in a fixed order, which robots.txt blocks:

js
CopyDownload
const INDEXABLE = {
"running-shoes": { color: ["red", "black"], brand: ["nike", "adidas"] },
};
function facetUrl(category, filters) {
const entries = Object.entries(filters);
if (entries.length === 1) {
const [[facet, value]] = entries;
if (INDEXABLE[category]?.[facet]?.includes(value)) {
return `/${category}/${value}/`;
}
}
entries.sort(([a], [b]) => a.localeCompare(b));
return `/${category}/?${new URLSearchParams(entries)}`;
}

The template then renders the two kinds of control differently:

html
CopyDownload
<!-- Indexable facet: a real link to a static URL -->
<a href="/running-shoes/red/">Red</a>
<!-- Every other filter: a control with no href, applied with JavaScript -->
<button type="button" data-facet="size" data-value="10">10</button>

Google's faceted navigation guidelines for URLs you don't index

Google's faceted navigation guidelines sort the options in two groups. robots.txt and URL fragments prevent crawling. Canonical tags and nofollow only signal a preference, and Google calls them "generally less effective in the long term". noindex isn't in the faceted navigation document at all; it controls indexing and still costs a crawl.

Method Stops crawling Keeps the URL out of the index Passes signals to the main page Google's faceted navigation doc
robots.txt disallow Yes Usually. A blocked URL can still be indexed without its content when other pages link to it No Recommended
URL fragments (#) Yes, no new URL exists Yes Not needed Recommended
noindex No, Google has to fetch the page to read it Yes No Not listed
rel="canonical" Slowly, over time Usually, since it's a hint Yes Less effective long term
rel="nofollow" on filter links Only if every link to the URL has it No No Less effective long term
Filters as buttons with no href Mostly, Google doesn't follow them Yes, while no page links to the URL No Not listed

robots.txt disallow

For filters you don't need in Search, this is Google's first recommendation: "Oftentimes there's no good reason to allow crawling of filtered items, as it consumes server resources for no or negligible benefit". Its example blocks three filter parameters and keeps one unfiltered listing open:

ts
CopyDownload
user-agent: Googlebot
disallow: /*?*products=
disallow: /*?*color=
disallow: /*?*size=
allow: /*?products=all$

Change the first line to User-agent: * so other crawlers follow it too. Keep product pages and the unfiltered category crawlable. robots.txt doesn't remove URLs that are already indexed, and a blocked URL that other pages link to can still appear in results without a description. Google's crawl budget guide adds that crawling freed up this way moves to other pages only when Google is already hitting your site's crawl capacity limit.

URL fragments

Google: "Google Search generally doesn't support URL fragments in crawling and indexing." Filters written after a # never create a new URL, so they cost nothing in crawling. Shared links still work, because the browser keeps the fragment and your JavaScript can read it. The trade-off: no fragment state can ever rank.

noindex

noindex removes a page from results, but Google has to crawl the page to see it. The crawl budget guide says it plainly: "Don't use noindex, as Google will still request, but then drop the page when it sees a noindex meta tag or header in the HTTP response, wasting crawling time."

Its best use is cleanup. If thousands of filter URLs are already indexed:

  1. Add noindex to them and keep them crawlable.
  2. Wait until they drop out of the Page indexing report's indexed pages.
  3. Then add the robots.txt disallow so Google stops requesting them.

rel="canonical"

Pointing a filter URL's canonical at the unfiltered page "may, over time, decrease the crawl volume of non-canonical versions of those URLs", says Google. Its December 2024 summary adds: "This one takes time to get picked up." Canonical is a hint, and Google can ignore it when the filtered page differs too much from the target. Use it on small stores without a crawl problem, or on filter URLs that collect external links you want to pass on. The target must itself be crawlable and indexable.

Google: "every anchor pointing to a specific URL must have the rel="nofollow" attribute in order for it to be effective." The December 2024 post adds that this means links "internal and external". You control only your own links, so any link from outside reopens the URL.

Filters as buttons

Google "can only crawl your link if it's an <a> HTML element (also known as anchor element) with an href attribute", according to its link best practices. Filters built as buttons or checkboxes that apply with JavaScript don't hand Google a URL to follow. The URL can still be found when a shopper shares it, so pair this with a robots.txt rule for the parameters.

Combinations that conflict

  • robots.txt and noindex on the same URL. Google's noindex documentation: "If the page is blocked by a robots.txt file or the crawler can't access the page, the crawler will never see the noindex rule". The page can stay indexed.
  • robots.txt and canonical on the same URL. Google never reads the canonical, so no signals move to the main page.
  • noindex plus a canonical to the category. One tag says drop this page, the other says it's a copy of another page. Pick one.
  • Filter URLs in the XML sitemap while you block, noindex or canonicalize them. The sitemap asks Google to index them.
  • A static facet page with a canonical to its parent. The page you built to rank tells Google not to rank it.
  • A broad robots.txt pattern that also matches static facet pages, such as Disallow: /*red. Test new rules with a robots.txt analyzer before you publish them.

Keep one parameter order and use & separators

Google's faceted navigation best practices for the filter URLs you do let crawlers fetch:

  • "Use the industry standard URL parameter separator '&'." Commas, semicolons and brackets "are hard for crawlers to detect as parameter separators".
  • For filters in the path, "ensure that the logical order of the filters always stays the same and that no duplicate filters can exist."

Build every filter link in one fixed order, whatever order the shopper clicked in. Alphabetical works, and so does a fixed facet order such as brand, color, size. If a request arrives in another order, redirect it with a 301 to the normalized URL. URLs with the same filter twice should return a 404.

Return a 404 for empty filter combinations

Google asks for a 404 when a filter combination "doesn't return results", and the same applies to duplicate filters, nonsensical combinations and pagination pages that don't exist. Don't redirect these to a common "not found" page. Serve the 404 at the URL that was requested.

Hide or disable filter values that would return zero products, so shoppers and crawlers rarely reach an empty page. A store that shows a friendly "no products match" message with a 200 status turns every empty combination into a soft 404.

Google notes that a single-page app may not be able to send a 404 for a URL the browser renders. If your storefront is a JavaScript app behind Encited, set <meta name="prerender-status-code" content="404"> on the empty state, and crawlers receive a real 404 status.

AJAX and JavaScript-only facets

How JavaScript filters affect SEO depends on what happens to the URL.

The filter updates the grid and the URL stays the same. Nothing new gets crawled, which suits size, price and sort filters. A filtered view without a URL can't be indexed, linked or shared, so it can never rank for "red running shoes". Valuable facets need a URL.

The filter rewrites the URL with JavaScript (the History API's pushState). Shoppers get a shareable URL, but crawlers find it only through an <a href> link somewhere. If the control is a button, Google won't discover the URL from your pages. For a facet you want indexed, render a real link to it, and make sure that loading the URL directly returns the filtered products in the HTML.

The storefront itself is a JavaScript app. On headless and single-page storefronts, loading a category or facet URL directly returns an empty shell and a bundle of scripts. Googlebot renders it later. GPTBot, ClaudeBot and PerplexityBot don't run JavaScript at all, so they see a category page with no products. The details are in JavaScript SEO and do AI crawlers render JavaScript.

Check a category page with the Googlebot simulator to see what a crawler receives. With Encited, crawlers get a pre-rendered snapshot of each page, so your categories and static facet pages reach Googlebot and AI crawlers with products, titles and links in the HTML. Shoppers keep getting the normal storefront, and the store's code doesn't change. If product data loads slowly, set window.prerenderReady = true once it's in, and the renderer waits for it. Keep non-indexable filter URLs blocked in robots.txt, so crawlers that respect it never request them and no snapshots get made for them.

Faceted navigation SEO on Shopify, Magento, WooCommerce and BigCommerce

Ecommerce SEO covers the rest of each platform.

Shopify

Shopify's storefront filters write parameters like filter.v.option.color=red, filter.p.vendor=nike, filter.v.price.gte=50 and filter.v.availability=1. The default robots.txt Shopify generates includes these rules, plus the same rules for localized paths:

ts
CopyDownload
Disallow: /collections/*sort_by*
Disallow: /collections/*+*
Disallow: /collections/*filter*&*filter*

So sort orders are blocked, tag combinations joined with + are blocked, and any URL with two or more filter parameters is blocked. A single filter such as /collections/shoes?filter.v.option.color=red stays crawlable. So does a multi-value filter written with commas, such as filter.v.option.color=red,blue.

To block single filters too, add a robots.txt.liquid template: in the theme code editor, add a new file under Templates. The template replaces Shopify's generated file. Shopify's help center calls it an unsupported customization and warns that "Incorrect use of the feature can result in loss of all traffic." Its developer docs say "it's strongly recommended to use the provided Liquid objects whenever possible." Save a copy of your current /robots.txt first and compare it with the new output. This version keeps every default rule and adds three:

liquid
CopyDownload
{% for group in robots.default_groups %}
{{- group.user_agent }}
{%- for rule in group.rules -%}
{{ rule }}
{%- endfor -%}
{%- if group.user_agent.value == '*' -%}
{{ 'Disallow: /*collections/*filter.v.price*' }}
{{ 'Disallow: /*collections/*filter.v.availability*' }}
{{ 'Disallow: /*collections/*filter.v.option.size*' }}
{%- endif -%}
{%- if group.sitemap != blank -%}
{{ group.sitemap }}
{%- endif -%}
{% endfor %}

The leading /* makes each rule match localized paths such as /fr/collections/ as well. For facets with demand, create a collection, such as /collections/red-running-shoes, with its own title and description, and link to it from the parent collection.

Magento and Adobe Commerce

Layered navigation adds the attribute code with an option ID (?color=49), price ranges (?price=50-100) and toolbar parameters: product_list_order, product_list_dir, product_list_limit and product_list_mode. Several layered navigation extensions can rewrite chosen filters to static URLs with their own titles. The robots.txt rules for these parameters, and the admin defaults that block more than you meant, are in Magento SEO.

WooCommerce

WooCommerce's built-in filters use filter_<attribute> (such as filter_color=red), query_type_<attribute>, min_price, max_price, rating_filter and orderby. Filter plugins often add their own parameters or path segments, so check the URLs on your own shop. Rules for the built-in ones:

ts
CopyDownload
User-agent: *
Disallow: /*?*filter_
Disallow: /*?*query_type_
Disallow: /*?*min_price=
Disallow: /*?*max_price=
Disallow: /*?*rating_filter=
Disallow: /*?*orderby=

Product categories and tags already have static URLs. Under Products, then Attributes, the "Enable archives?" option gives an attribute its own archive pages, which can serve as indexable facet pages for terms with demand.

BigCommerce

BigCommerce adds _bc_fsnf=1 to listing URLs with product filters applied, and adds two robots.txt rules automatically:

ts
CopyDownload
Disallow: /*?_bc_fsnf=1*
Disallow: /*&_bc_fsnf=1*

These rules don't appear in your store settings. BigCommerce's help center explains them: "This prevents search engine robots from crawling storefront listing pages with product filters applied." For facets with demand, use brand pages and subcategories, which have their own URLs, titles and descriptions.

Faceted navigation best practices checklist

  • List every facet and how it writes the URL: parameter, fragment or path.
  • Measure the problem in Crawl Stats, the Page indexing report, your logs and a site crawl.
  • Pick the facet combinations with search demand and enough products, usually one facet deep.
  • Give each one a static URL, a self-referencing canonical, its own title, H1 and description, and plain links from the category.
  • Add those pages to the XML sitemap. Keep every other filter URL out of it.
  • Block the remaining filter parameters in robots.txt under User-agent: *, and in any crawler-specific groups.
  • Keep the unfiltered category, its pagination and every product page crawlable.
  • Never combine a robots.txt block with noindex or canonical on the same URL.
  • Use & between parameters and one fixed parameter order. Redirect other orders to it.
  • Return a 404 for empty, duplicate and nonsensical filter combinations.
  • Hide filter values that would return zero products.
  • On a JavaScript storefront, check that category and facet pages carry products and links in the HTML crawlers receive.
  • Recheck Crawl Stats and your logs a few weeks after each change.

FAQ

What is faceted navigation in SEO? Faceted navigation is the set of filters on a category or search page that lets visitors combine attributes such as brand, color, size and price. In SEO it matters because each combination can become a separate URL. Left alone, those URLs take up crawling and fill the index with near-duplicate pages. Handled well, a few of them rank for searches like "red running shoes".

What is the difference between filtering and faceted search? A filter narrows a list by one attribute, or sorts it. Faceted search combines several independent attributes at once, usually shows how many items match each value, and updates the remaining options as you choose. Facets multiply the number of possible pages, which is why they need deliberate SEO handling.

Why does faceted navigation cause crawl budget waste and index bloat? Every filter combination can be a unique URL, so a modest catalog produces millions of crawlable pages. Crawlers can't tell which ones are useful without fetching them, so they spend requests on filter pages while new products wait. Some of those near-duplicate pages get indexed and compete with your categories.

Should faceted navigation URLs be blocked with robots.txt, set to noindex, or canonicalized? For filters with no search demand, Google recommends blocking them in robots.txt or using URL fragments. Use noindex to clean up filter pages that are already indexed, then block them once they're gone from the index. Canonical tags suit small stores without a crawl problem, and Google says they work less well over time. Never use robots.txt and noindex on the same URL.

How do you audit faceted navigation for crawl traps? Click through your filters and note how each one changes the URL. Check Crawl Stats in Search Console for filter URLs among the example requests, and the Page indexing report for filter URLs that are indexed or crawled and not indexed. Count Googlebot hits on parameter URLs in your log files, and run a site crawl to see how many URLs a bot can reach.

When should AJAX or JavaScript be used for faceted navigation? Use JavaScript filters that don't create crawlable links for facets with no search value, such as size, price and sort. Facets with demand need a real URL, an <a href> link and content in the HTML when the URL loads directly. On a JavaScript storefront, check that crawlers get the products in the HTML, since most AI crawlers don't run JavaScript.

How do you turn high-demand facet combinations into landing pages? Find "[attribute] [category]" searches with real volume, check you have enough products for each, and build a static URL for each one. Give it a unique title, H1, description and short intro, a self-referencing canonical, links from the parent category and an entry in your sitemap.

Does Google still have a URL Parameters tool? No. Google deprecated the URL Parameters tool in Search Console in 2022 and said its crawlers learn how to handle parameters on their own. robots.txt rules, canonical tags and clean URLs are the controls left.

Do AI crawlers crawl faceted navigation URLs? Yes, when they find them in links and robots.txt doesn't block them. Put facet rules under User-agent: * and repeat them in any group for a specific AI crawler, because a crawler reads only the most specific group that matches it.

Google
Gemini
ChatGPT
Claude
Grok
Meta
Perplexity

Get your store ranked in AI

See how ChatGPT, Gemini, Claude and Perplexity recommend your products and which stores they pick instead.

Talk to sales
Avatar
How can we help?
Get instant answers to your questions or leave a message for an engineer will reach out
Ask AI about Encited
See our docs
Contact support
Leave a message
We'll get back to you soon
Avatar
Ask AI about Encited
Product questions, troubleshooting and
Thinking
Preview
Drop an image to attach
Powered by ReplyMaven