All APIs
0.3¢ per page10 datapoints
Web Crawl API
Crawl a website from one start URL and get every page it links to as clean Markdown, with title, description and link depth. 50 pages by default, up to 1,000. Only pages that came back are charged.
Sample
Sample data
Here's a sample run of crawled pages, showing the exact schema and results you can expect.
| # | URL | Title | Description | Markdown | Word Count | Depth | Status Code | Fetched At | Engine | Served From Cache |
|---|---|---|---|---|---|---|---|---|---|---|
1 | Scrape | Firecrawl | Turn any URL into clean Markdown or structured data | > ## Documentation Index
>
> Fetch the complete documentation index at: [/llms.txt](https://docs.firecrawl.dev/llms.txt)
>
> Use this file to discover all available pages before exploring further.
[Skip to main content](https://docs.firecrawl.dev/features/scrape#content-area)
Scrape turns any URL into clean Markdown or structured data for AI agents, including JS-heavy pages and dynamic apps.
- It manages complexities: proxies, caching, rate limits, js-blocked content
- Handles dynamic content: dynamic websites, js-rendered sites, PDFs, images
- Outputs clean markdown, structured data, screenshots or html.
For details, see the [Scrape Endpoint API Reference](https://docs.firecrawl.dev/api-reference/endpoint/scrape).
[**Try it in the Playground** \\
\\
Test scraping in the interactive playground — no code required.](https://www.firecrawl.dev/playground?endpoint=scrape)
Scraping a document at a URL, or parsing one from disk? This walks through when to use Scrape and when to use [Parse](https://docs.firecrawl.dev/features/parse):
If a request fails, see [Errors](https://docs.firecrawl.dev/api-reference/errors) for the full catalog of error codes, causes, remedies, and retry guidance.
## [](https://docs.firecrawl.dev/features/scrape\#scraping-a-url-with-firecrawl) Scraping a URL with Firecrawl
### [](https://docs.firecrawl.dev/features/scrape\#/scrape-endpoint) /scrape endpoint
Used to scrape a URL and get its content.
### [](https://docs.firecrawl.dev/features/scr | 50,895 | 2 | 200 | 2026-11-09T10:28:08Z | crawler | true | |
2 | Alexandria | Firecrawl | The knowledge library for superintelligence | > ## Documentation Index
>
> Fetch the complete documentation index at: [/llms.txt](https://docs.firecrawl.dev/llms.txt)
>
> Use this file to discover all available pages before exploring further.
[Skip to main content](https://docs.firecrawl.dev/features/alexandria#content-area)
PodcastsFinanceRetail
Pause
〉Find podc
Alexandria gives agents access to structured data through Firecrawl. Discover a tool, inspect its inputs, then run it. Discovery is free; execution uses the credits listed on the tool.[Browse providers](https://www.firecrawl.dev/app/alexandria) · [Manage provider terms](https://www.firecrawl.dev/app/settings?tab=data-sources) · [Sports and fantasy data example](https://docs.firecrawl.dev/use-cases/sports-fantasy)
## [](https://docs.firecrawl.dev/features/alexandria\#built-for-agents) Built for agents
Install the [CLI](https://docs.firecrawl.dev/sdks/cli) or connect the [MCP server](https://docs.firecrawl.dev/mcp-server).
- Firecrawl CLI
- MCP
```
# Find tools alongside web results.
firecrawl search "podcast conversations about AI agents" --sources web,alexandria --domain-tools --limit 2
# Inspect inputs and pricing.
firecrawl find-tools --options '{"providers":["particle"],"level":"tools","expand":["options","response"]}' --include-costs
# Run the tool.
firecrawl scrape particle/podcasts/episodes/search --options '{"keyword_search":"AI agents","limit":2}'
```
Install with `npm install -g firecrawl-cli` and sign in with `firecrawl login`.
Ask you | 15,216 | 2 | 200 | 2026-11-09T10:28:08Z | crawler | true | |
3 | Entire web-scale monitoring | Firecrawl | Run always-on web searches and alert when new matching results appear | > ## Documentation Index
>
> Fetch the complete documentation index at: [/llms.txt](https://docs.firecrawl.dev/llms.txt)
>
> Use this file to discover all available pages before exploring further.
[Skip to main content](https://docs.firecrawl.dev/features/monitoring-web-scale#content-area)
Entire web-scale monitoring is an always-on search that watches the web and pings you or your agent the moment something comes online.Page and website monitors watch URLs you name. An **entire web-scale** monitor watches the whole web. Instead of diffing pages you already know about, you give it `queries` to run plus a `goal`, and Firecrawl runs the queries on every check and alerts on **new** results the judge finds relevant to the goal. It’s discovery rather than diffing.Each check runs the same cycle: take the goal and its `queries`, apply a recency window, run the search, dedupe the results by canonical URL, let the optional AI judge decide which new results are meaningful to the goal, and alert through the same webhook and email channels as scrape and crawl monitors. Scheduling, goals, judging, and notifications all work exactly as described in the [Monitoring overview](https://docs.firecrawl.dev/features/monitoring).
Page and crawl monitors diff content on URLs you name; web-scale monitors discover new results across the web. Same scheduling, judge, and notifications underneath.
## [](https://docs.firecrawl.dev/features/monitoring-web-scale\#search-target) Search target
A searc | 15,847 | 2 | 200 | 2026-11-09T10:28:08Z | crawler | true |
Playground
Run this API
Advanced parameters are collapsed below.
Input Form
Fill in the fields below or .
0.3¢ per page
Est. up to$0.1550 pages
Output limits
live
curl -X POST "https://api.mindcase.co/v1/data/web/crawl/run?wait=true" \
-H "Authorization: Bearer mk_live_YOUR_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"params": {
"url": "",
"includePaths": [],
"excludePaths": []
}
}'Edit the form to update this live.
Related
Related APIs
Web Backlinks API
Backlinks pointing at a domain, with source URL and title, target URL, anchor text and authority scores. Pass the domains.
Web0.8¢ per backlink
Web Brand Styleguide API
A website's brand style guide, with site name, title, description, language and the colors, fonts and logos it uses. Pass the URLs.
Web0.35¢ per style guide
Web Extract API
Pull structured JSON out of any web page: name the fields you want, or send a JSON Schema, and get one row per URL with the values. Pages are always fetched live. Failed extractions and schema mismatches are not charged.
Web1¢ per page
Web Map API
Every URL on a website in one call: sitemaps plus link discovery, with each URL's last-modified date and where it was found. One row per site, up to 5,000 URLs, $0.002 per site. Pass the site URLs.
Web0.2¢ per site
Web Scraping API
Scrape any web page or PDF live into clean Markdown with every link kept, plus title, description, author, published date, word count and the cleaned HTML. Pages that cannot be scraped come back with a typed error and are not charged. Scrape a list of URLs, or search by keyword and scrape the top results.
Web0.25¢ per page
Web Search API
Search the web for AI agents: ranked results with a page-text excerpt for each one, the published date when the page has one, and the domain. One result set per query, ready to drop into a prompt.
Web0.1¢ per result