Tools
/
Crawler
/
APIs
/
Configuration
Jan. 17, 2022
Crawler: ExtraUrls
Type:
string[]
Parameter syntax
extraUrls: [ 'http://www.example.com', ... ]
About this parameter
URLs found in extraUrls are treated as startUrls for your crawler: they are used as starting points for the crawl.
Crawler saves URLs added through the Add a URL field of the Admin’s Settings tab to the extraUrls array.
Internally extraUrls is treated like startUrls. The separate parameter identifies which URLs are added through the configuration file, and which are added through the Admin.
Examples
Copy
1
2
3
{
extraUrls: ['https://www.algolia.com/blog/'],
}
Did you find this page helpful?
