Tools / Crawler / APIs / Configuration

Crawler: IgnoreQueryParams

Type: string[]
Parameter syntax
ignoreQueryParams: [
  'param',
  'param2_*',
  ...
]

About this parameter

Filters out specified query parameters from crawled URLs. This can help you avoid indexing duplicate URLs. You can use wildcards to pattern match.

Examples

In this example, the ref and all utm_ parameters are ignored in crawled URLs. Your crawler saves http://localhost?page=1&ref=algolia&utm_source=doc as http://localhost?page=1.

1
2
3
{
  ignoreQueryParams: ['ref', 'utm_*'],
}
Did you find this page helpful?