Synchronous and asynchronous web scraping costs

Use a synchronous request for one page and a background job for a supplied list or bounded crawl.

Choose the right endpoint

NeedEndpointLifecycle
One known pagePOST /web/v1/scrapeRead the response directly
2–50 known URLsPOST /tasks/v1/scrape/batchSave jobId, then poll status
Discover and read linked pagesPOST /tasks/v1/crawlSet a limit, save jobId and poll

Plan a startup workload

For 10,000 fresh single-format Markdown page reads, the extraction estimate is $20. For 10,000 fresh JSON outputs it is $50. These estimates exclude extra formats, discovery, browser sessions, research and external storage. A crawl reading Markdown also extracts links and therefore has a different per-page price.

Inspect the returned billing and errors; not every attempted read returns usable data. Account-credit jobs and HTTP x402 packages can have different settlement details. Read task billing.

Start a batch

curl https://api.oassis.dev/tasks/v1/scrape/batch \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"urls":["https://example.com/","https://example.org/"],"formats":["markdown"]}'

Keep costs bounded

  • Map a site before deciding which pages to read.
  • Request only the formats you need.
  • Use suitable cache freshness when a cached observation is acceptable.
  • Poll the existing job; do not create another job to check progress.
  • Set crawl limits and prevent overlapping scheduled jobs.

Try Scrape & Map · API quick start · Estimate your cost

Oassis basic fresh Markdown extraction: $0.002 per page output. All operation prices and calculator.