DocumentationScraping APIResults and Polling

Results and Polling

When a task cannot be completed instantly, the API returns a taskId (HTTP 201). Poll the result endpoint with that taskId until the data is ready (HTTP 200).

HTTP Status Codes

CodeMeaningAction
200SuccessUse the response body data directly.
201Task in progressPoll /result/{taskId} (recommended interval: 1-5 seconds).
400Invalid parametersPlease check if the task parameters are valid.
429Rate limit exceededReduce request frequency or contact support for quota adjustment.
500Internal server errorRetry after 1 minute; contact support if persistent.

Polling for Results

Call the result endpoint with your taskId until it returns HTTP 200.

curl --location --request GET 'https://api.scrapeless.com/api/v1/scraper/result/30681c8b-bfd3-48eb-a7c9-006e40b00591' \
--header 'x-api-token: YOUR_API_KEY' \
--header 'Content-Type: application/json'

Notes

  1. Polling Recommendations
    1. Interval: 1-5 seconds.
    2. Timeout: Set a maximum retry limit (e.g., 10 attempts).
  2. Debugging Tips
    1. Test with simple URLs first.
EndpointsOverview