Tools
/
Crawler
/
APIs
/
Configuration
Jan. 17, 2022
Crawler: IgnoreQueryParams
Type:
string[]
Parameter syntax
ignoreQueryParams: [ 'param', 'param2_*', ... ]
About this parameter
Filters out specified query parameters from crawled URLs. This can help you avoid indexing duplicate URLs. You can use wildcards to pattern match.
Examples
In this example, the ref
and all utm_
parameters are ignored in crawled URLs. Your crawler saves http://localhost?page=1&ref=algolia&utm_source=doc
as http://localhost?page=1
.
Copy
1
2
3
{
ignoreQueryParams: ['ref', 'utm_*'],
}
Did you find this page helpful?