Filter pages, in online shop SEO, are category or list pages that get their own URL after a visitor selects filters such as color, size or brand, usually through URL parameters. A few filters can produce a very large number of near-identical URLs.
Why do filter pages matter for SEO?
Google says parameter-based faceted navigation can create nearly infinite URL spaces. Crawlers only recognize the low value of these URLs after many requests. That uses server resources and delays the discovery of new, useful URLs.
Google distinguishes two cases:
- Filter URLs should not appear in search. Google recommends blocking them with robots.txt or using URL fragments for filters. It calls
rel="canonical"andrel="nofollow"generally less effective in the long term. - Filter URLs may be indexed. Google recommends the
&character to separate parameters, a consistent filter order and a 404 status for combinations without results.
Whether a combination should be indexable depends on whether people search for it (assessment).
Example
https://example.com/shoes?color=green&size=42
To keep such URLs from being crawled, robots.txt can disallow them:
user-agent: Googlebot
disallow: /*?*color=
disallow: /*?*size=
Four filters with nine values each and a “not set” option add up to 10,000 URL combinations for a single category. (Calculated example.)
Sources
- Managing crawling of faceted navigation URLs – Google Search Centraldevelopers.google.com
- Pagination and incremental page loading – Google Search Centraldevelopers.google.com
Last updated: