Tools / Crawler / APIs / Configuration

Crawler: Sitemaps

Type: string[]
Parameter syntax 
sitemaps: [
  'http://www.example.com',
  ...
]
See code examples

About this parameter

URLs found in sitemaps are treated as startUrls for the crawler: they are used as starting points for the crawl.

Examples

Copy 
1
2
3

{
  sitemaps: ['https://www.algolia.com/sitemap.xml'],
}
Previous
startUrls
Next
ignoreRobotsTxtRules
Did you find this page helpful?