Context.dev: the web data API

Fast web scraping with browsers, proxies, retries, batches, and monitors built in.

Get data from the internet, fast. Context.dev handles the scraping infrastructure so you can turn web pages into Markdown, structured JSON, screenshots, and more through one API.

Start with one URL, scrape thousands of pages in a batch, or monitor sites for changes.

Quality comes standard. JavaScript rendering and managed proxies are always on for web scraping, with no opt-out. We keep both enabled by design to maximize data quality and reliability, so you can focus on building.

Quickstart

Get an API key and make your first request.

Agent quickstart

Paste one prompt into your coding agent to set up Context.dev.

API reference

Check each endpoint’s parameters and response fields.

Make a request

This request scrapes example.com and returns its main content as Markdown. The examples read your API key from CONTEXT_DEV_API_KEY; the Quickstart covers getting a key and installing an SDK.

TypeScript

import ContextDev from "context.dev";

const client = new ContextDev({ apiKey: process.env.CONTEXT_DEV_API_KEY });

const page = await client.web.scrape({
  url: "https://example.com",
  formats: { markdown: true },
  sharedParams: { mainContentOnly: true },
});

console.log(page.markdown.data);

The page text is in markdown.data. The page title and description are in metadata.

Scraping infrastructure, handled

• Browsers. JavaScript rendering comes built in. Use browser actions to click, type, and scroll before capturing a page.
• Proxies and retries. Context.dev manages proxy selection and fetch retries. Choose a fetch country when location matters.
• Fast results. Get multiple formats from one page visit. Reuse cached outputs for repeated reads, with control over freshness.
• Batches. Process thousands of URLs as a background job with queuing, progress tracking, and downloadable results.
• Monitors. Watch pages and sites on a schedule and receive changes by webhook.

Choose an API

You have	You want	Use
A URL	Page content, structured data, or screenshots	Scrape
A list of URLs, or a site to crawl	Results from a background job	Batches
A page or site to watch	A webhook when it changes	Monitors
A domain	Its URLs, with available titles and descriptions	Map URLs
A starting URL	Linked pages as Markdown in one response	Crawl
A search query	Ranked web results, with page content if you ask for it	Search
A research question and a JSON shape	An answer in that shape, with source URLs	Answers
A PDF, Office document, image, or other file	Its content as Markdown	Parse

The same API also provides brand data, people enrichment, and company news.

Use Context.dev from an agent

The Agent quickstart gives your coding agent one prompt that picks a setup, connects your account, and verifies a first result. To set up one piece yourself, connect the MCP server for live tools, install the agent skill to teach the agent the API, or use the CLI in scripts.

Before you ship

Context.dev is a hosted API with SDKs for TypeScript, Python, Ruby, Go, and PHP. The production checklist covers timeouts, retries, and API key permissions. See Credits and pricing for usage costs and each guide for limits and failure handling.

APIs

Scrape

Turn any page into usable data.

Map

Discover the URLs on a website.

Crawl

Follow links and collect page content.

Search

Search the web for relevant results.

Answers

Research questions with cited sources.

Parse

Extract content from documents and images.

Brand

Get logos, colors, fonts, and more.

People

Find people and enrich their profiles.

News

Find the latest coverage of companies.

Batches

Process thousands of URLs in parallel.

Monitors

Track changes across pages and sites.

Account and operations

API keys

Create keys and control API access.

Plans and billing

Manage your plan and payment details.

Team access

Invite teammates and manage their roles.

ZDR usage

Keep request content out of retained logs.

Request logs

Inspect requests and track your usage.

Timeouts

Set time limits for your requests.

Rate limits

Plan throughput and handle rate limits.