AI Scraper
AI engines, prompts, task results, and webhooks.
What does AI Scraper collect?
AI Scraper collects responses from supported AI engines, with fields such as answer content and citations depending on the engine. It is suited to answer comparison and brand monitoring. See the AI Scraper overview.
Can I use it to retrieve private chat history?
The documented AI Scraper data scope is publicly accessible data that does not require authentication. Do not treat it as an interface to private chat history or authenticated user conversations.
Why is my task still running?
Read the task status before interpreting the payload. pending and running are not completed results; success and failed are terminal states. Follow the Task Lifecycle guide for polling and response handling.
Can results be delivered by webhook?
Yes. Configure the supported webhook.url with an HTTPS receiver. Keep the task identifier so your receiver can associate the result with the original request.
Why are two answers to the same prompt different?
Compare the engine, input settings, location, and collection time before treating the results as equivalent observations. Save that context alongside each answer so you can investigate differences rather than relying on prompt text alone.
Why are citations or other fields missing?
Read the selected engine’s output guide. Do not assume every engine or response contains every field. Distinguish an absent optional field from a failed task, and preserve the raw result for debugging.
How long should I wait before saving a result?
Retrieve and store results promptly. The Task Lifecycle guide documents a 12-hour availability window and HTTP 410 for expired results. A completed task should not be treated as permanent storage.
Am I billed if I never retrieve the result?
A produced result can still be billed even if your application never retrieves it. Result delivery and task execution are separate. See Subscription & Billing for billing help.
Is Amazon Alexa the same as Amazon Scraper?
No. Amazon Alexa is listed among AI Scraper engines. Amazon Scraper belongs to Scraping API and serves Amazon data collection. See the Scraping API FAQ.
Choose another category from the FAQ navigation, or contact support.