Crawler: MaxDepth

About this parameter

Limits the processing of URLs to the specified depth, inclusively.

This parameter can’t be higher than 100.

URLs added manually (startUrls, sitemaps) are not checked against this limit.

How we calculate depth:

1
2
3
4
5
6
7
http://example.com          => 1
http://example.com/         => 1
http://example.com/foo      => 1
http://example.com/foo/     => 2
http://example.com/foo/bar  => 2
http://example.com/foo/bar/ => 3
...

Examples

1
2
3
{
  maxDepth: 10,
}