Create Sitemap Source task

post/v1/sources/tasks

Authorizations

Authorizationstringheaderrequired

Use an account access token as Bearer <token>.

Get an access token ↗

Read an XML sitemap or follow the sitemaps listed in an index. Retrieve page URLs and last-modified timestamps as flat objects without a collection or input rows.

Public ID: sitemap-source. Get the current definition. You can read it without authentication. Confirm availability in the source catalog.

Settings

Set sitemapUrl to the full sitemap URL. You can set filterRegex to keep matching page URLs; matching ignores case.

sitemapSourceLimit defaults to 95,000 and cannot exceed that value. It applies across the whole parsing task. When several sitemaps are processed at once, the result count can exceed your requested limit.

For very large sitemap indexes, submit individual sitemap URLs to stay within processing limits.

Missing modification dates return null. Dates without a time use midnight UTC; timestamps without a time zone are treated as UTC.

sitemapUrlstringrequired

Full sitemap URL, such as https://www.datablist.com/sitemap.xml. Sitemap indexes are followed automatically.

format: "uri"

filterRegexstring

Keep only page URLs matching this regular expression.

sitemapSourceLimitnumber

Requested maximum number of page URLs across the task. Defaults to 95,000; concurrent work can exceed a smaller requested limit.

Additional properties are supported.

Credits and limits

Cost: 1 credit per 150 URLs parsed.

This source requires a balance of at least 40 credits before execution. Parsing costs 1 credit per 150 returned URLs, proportionally rather than rounding to a complete block. Downloads requiring the protected-site fallback can add 1 credit. Work producing no URLs can still incur a download charge.

Tasks can run for up to 24 hours; completed, failed, or stopped tasks are kept for 90 days. Enrichment and source tasks share your account balance and task limits. Set maxCredits to stop starting new work after a credit threshold; work already underway can still exceed it. See limits and errors.

Accepted task

The API returns 202 Accepted with a task ID. Save it and check links.self every few seconds. Once the task is completed, failed, or stopped, get Sitemap Source task results. The response below is sample data.

Sitemap Source overview · Shared task reference

Request

PythoncURLJavaScriptPHPGo

import requests

url = "https://api.datablist.com/v1/sources/tasks"

headers = {
    "Accept": "application/json",
    "Authorization": "Bearer <token>",
    "Content-Type": "application/json"
}

payload = {
    "sourceId": "sitemap-source",
    "uniqueId": "sitemap-source-example",
    "settings": {
        "sitemapUrl": "https://example.com/sitemap.xml",
        "sitemapSourceLimit": 100
    }
}

response = requests.post(url, headers=headers, json=payload)

print(response.text)

Response · illustrative example

202

{
  "@id": "00000000000040008000000000000001",
  "@type": "SourceTask",
  "kind": "source",
  "sourceId": "sitemap-source",
  "uniqueId": "sitemap-source-example",
  "status": "queued",
  "createdAt": "2026-10-09T10:00:00Z",
  "startedAt": null,
  "finishedAt": null,
  "progress": {
    "results": 0
  },
  "credits": {
    "used": "0",
    "max": null
  },
  "error": null,
  "links": {
    "self": "https://api.datablist.com/v1/sources/tasks/00000000000040008000000000000001",
    "results": "https://api.datablist.com/v1/sources/tasks/00000000000040008000000000000001/results"
  }
}