First scrape

Call POST /scrape with a URL and one or more output formats.

curl https://api.berrycrawl.com/api/v1/scrape \
  -H "Authorization: Bearer $BERRYCRAWL_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "url": "https://berrycrawl.com",
    "formats": ["markdown"]
  }'

A successful response places requested formats under data and includes request metadata such as status, source URL, and credit use.

{
  "success": true,
  "data": { "markdown": "# Web data for AI agents\n..." },
  "metadata": { "url": "https://berrycrawl.com", "statusCode": 200 }
}

JavaScript-rendered pages

You do not need a separate browser mode. Berrycrawl uses Patchright for normal scrape rendering and escalates through the configured proxy tier only when direct access is blocked. Use proxy: "auto" for the default policy. Use proxy: "none" only when you prefer a clean failure over a proxied request.

Add another format

Formats can be combined in one request:

{
  "url": "https://example.com/product",
  "formats": ["markdown", "links", "screenshot"],
  "onlyMainContent": true
}

Each expensive format adds to the operation's credit cost. Request only data the next step will consume.