What’s New in v2
Better Sitemap Control
Three ways to handle sitemaps:"include"
- Use sitemap + find other pages (default)"skip"
- Ignore sitemap completely"only"
- Only return sitemap URLs
Response format changed
We now return the links in thelinks
array of objects with enhanced metadata.
Authorizations
Bearer authentication header of the form Bearer <token>
, where <token>
is your auth token.
Body
application/json
The base URL to start crawling from
Search query to use for mapping. During the Alpha phase, the 'smart' part of the search functionality is limited to 500 search results. However, if map finds more results, there is no limit applied.
Sitemap mode when mapping. If you set it to skip
, the sitemap won't be used to find URLs. If you set it to only
, only URLs that are in the sitemap will be returned. By default (include
), the sitemap and other methods will be used together to find URLs.
Available options:
skip
, include
, only
Include subdomains of the website
Do not return URLs with query parameters
Maximum number of links to return
Required range:
x <= 30000
Timeout in milliseconds. There is no timeout by default.