Inventory how combinations create URLs
List which filters and sorting actions change the URL. Inspect parameter order, values and multiple paths to substantially the same view. Learn the behavior on a small representative set before attempting an unrestricted crawl. Define an authorized scope and load boundary, because a combinatorial URL space can make a seemingly simple audit much larger than the visible product count suggests.
Choose intentional search landing pages
Separate useful landing pages with a distinct answer from temporary sorting and narrow interaction states. An apparently attractive phrase does not justify publishing every combination as an independent page. State the audience question for intentional entries and decide how duplicate answers are handled. The publication policy should follow reader value rather than the number of URLs the interface can generate.
Distinguish crawl control from indexing exclusion
Crawl control and processing a page’s noindex directive are different mechanisms. Blocking access can prevent a crawler from reading an on-page instruction. Define the intended outcome and consult the documented method before combining controls. Search exclusion is also not a confidentiality boundary. Keep restricted material protected by appropriate access control rather than relying on how a public search system may treat its URL.
Example: inspect an empty combination and a sort change
In an illustrative shop, test an empty blue-and-extra-large combination and a price-sorted view of an unchanged set. Inspect responses, recovery navigation and generated links. Do not portray a mere order change as a distinct collection with a different answer. Validate the chosen preferred-URL and navigation policy against the actual response instead of assuming the filter interface implements it consistently.
Retest when inventory or templates change
New inventory and filters can create combinations absent from the original test. Retest intentional entries, narrow states and empty results when templates change. A growing discovered-URL count is not an improvement metric by itself. Preserve useful access while managing unnecessary expansion, and leave the policy and exceptions with the implementer so the next release does not recreate the original problem.
Official sources
Pricing, availability and feature limits can change. Check the linked official pages before subscribing.
- Google faceted navigation guidanceInformation checked: 2026-10-28
- Google noindex processingInformation checked: 2026-10-28
- Google canonical URL methodsInformation checked: 2026-10-28
- Google internal link guidanceInformation checked: 2026-10-28
- Screaming Frog SEO SpiderInformation checked: 2026-10-28
- Screaming Frog pricingInformation checked: 2026-10-28
- Sitebulb website auditingInformation checked: 2026-10-27
- Sitebulb Desktop pricingInformation checked: 2026-10-28
- Sitebulb Desktop and CloudInformation checked: 2026-10-28
- About Google Search ConsoleInformation checked: 2026-10-27
- Search Console performance metrics and setupInformation checked: 2026-10-27
- Search Console dimensions and data groupingInformation checked: 2026-10-27