Build with Berrycrawl

Turn websites into clean data, screenshots, site maps, and brand profiles for AI agents.

Berrycrawl is a web-data API built for agents. Send it a URL and ask for the form your workflow needs: readable Markdown, a timestamped YouTube transcript, raw HTML, links, a screenshot, structured JSON, a crawl, or a brand profile.

Make your first request

Scrape a page into Markdown with one authenticated API call.

Set up a coding agent

Give an agent one prompt. It will inspect the repo and ask for one server-side env variable.

Track an async job

Start a crawl or extraction, poll its job, and read results as they arrive.

Choose a workflow

Compare scraping, crawling, screenshots, mapping, search, and extraction.

Read a YouTube transcript

Turn a YouTube URL into timestamped text through its focused endpoint.

Use an SDK

Generate typed clients from Berrycrawl's public OpenAPI specification.

Read the API reference

Inspect every public operation, parameter, request body, and response schema.

Base URL

All public data-plane requests use:

https://api.berrycrawl.com/api/v1

Authenticate with a bc_ API key in the bearer header. JSON is the default request and response encoding.

Authorization: Bearer bc_your_api_key
Content-Type: application/json

Pick the smallest operation that solves the job

Need	Start with
One page as Markdown, HTML, links, JSON, or a PDF	`POST /scrape`
A timestamped transcript from a YouTube video	`POST /youtube/transcript`
A durable image of a page	`POST /screenshot`
A PDF, Word document, or spreadsheet as text	`POST /parse`
URLs from one site without fetching every page	`POST /map`
Pages across a site	`POST /crawl`
Search results from the public web	`POST /search`
Structured facts from one or more pages	`POST /extract`
The complete public brand behind a website	`POST /brand`

Berrycrawl starts with the least expensive reliable fetch and escalates when a site requires browser rendering or a residential IP. You request the result; the platform owns the browser and proxy decisions.

Free test domain

Requests for berrycrawl.com are free, so an agent can validate its integration before spending credits. New workspaces receive 100 credits; paid credits are added through pay-as-you-go top-ups.