The web, LLM-ready

Turn any URL into clean, LLM-ready data.

One API for scraping, crawling, search, and structured extraction. Point it at a link, a whole site, or a query. Get back Markdown, JSON, and structured entities a model can use right away.

Quickstart →$ Get an API key

Scrape

One URL in, clean Markdown and structured data out. The core primitive.

Map

Discover every URL on a site, fast, before you decide what to pull.

Crawl

Walk a whole site and scrape every page as one asynchronous job.

Search

Run a query and get ranked results, each scraped to clean data.

Extract

Pull schema-shaped JSON from pages, with per-field confidence and sources.

Media

Capture a full-page screenshot or collect a page’s images.

Why Hydrafetch

LLM-ready by default

Output is clean Markdown and normalized structured data. No boilerplate, no navigation cruft, no half-rendered pages.

One surface for the whole job

Scrape, crawl, map, search, and extract share the same options and the same clean response shape.

Trustworthy extraction

Structured extraction can return, per field, how confident it is and the exact passage a value came from.

Predictable cost

Every call is billed in credits, charged only on success, and each response tells you what it consumed.

Your first call

Send a URL, get clean Markdown back.

curl -X POST https://api.hydrafetch.com/v1/web/scrape \
  -H "X-API-Key: $HYDRAFETCH_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{ "url": "https://example.com" }'

const res = await fetch("https://api.hydrafetch.com/v1/web/scrape", {
  method: "POST",
  headers: {
    "X-API-Key": process.env.HYDRAFETCH_API_KEY!,
    "Content-Type": "application/json",
  },
  body: JSON.stringify({ url: "https://example.com" }),
});

const { data } = await res.json();
console.log(data.markdown);

import os, requests

res = requests.post(
    "https://api.hydrafetch.com/v1/web/scrape",
    headers={"X-API-Key": os.environ["HYDRAFETCH_API_KEY"]},
    json={"url": "https://example.com"},
)
print(res.json()["data"]["markdown"])

How it works

Get an API key

Every request carries your key in the X-API-Key header. See Authentication.

Call an endpoint

Send a URL, or a query, to the endpoint that fits your job. Most calls return clean data synchronously.

Get clean data back

Responses are LLM-ready: Markdown, structured entities, extracted JSON, links, summaries, or images.

Base URL

All endpoints live under a single versioned base URL:

https://api.hydrafetch.com/v1/web

Ready to make your first call? Head to the Quickstart.

Get started

Core concepts

Web Scraping

Web Extraction