Skip to content
@scrapfly

Scrapfly

Scrapfly · the web data layer for scrapers and AI agents

Website Docs 5 APIs · One key Get free API key


Core APIs

One key unlocks all five.

API What it does Docs
Web Scraping Scrape any page, bypass anti-bot, render JS at scale docs
Cloud Browser Remote stealth browsers with full CDP for automation docs
Screenshot Full-page screenshots, auto-scroll, element capture, PDF docs
Extraction AI-powered structured data from HTML and documents docs
Crawler (beta) Crawl entire sites with a single API call docs

Platform & Tools

  • 🔌 MCP Server — Connect Claude, Cursor, and other LLM clients to live web data. → Repo
  • 🤖 AI Browser Agent (new) — Automate any site with natural language. Self-healing, structured JSON output. → Try it
  • ⌨️ Scrapfly CLI — Agentic shell for scraping, extraction, screenshots, and autonomous crawls. Works in terminals and CI. → Product page · Docs · Repo
  • 🛡️ Antibot Detector (beta) — Identify which antibot guards any site (Cloudflare, DataDome, Akamai, Kasada, +20 more). → Product page · Repo

SDKs & Libraries

Language Repo Install
CLI scrapfly-cli curl -fsSL scrapfly.io/cli | sh
Python python-scrapfly pip install scrapfly-sdk
TypeScript / JS typescript-scrapfly npm i scrapfly-sdk
Go go-scrapfly go get github.com/scrapfly/go-scrapfly
Rust rust-scrapfly cargo add scrapfly-sdk
Scrapy docs pip install "scrapfly-sdk[scrapy]"
n8n n8n-nodes-scrapfly n8n community node

LLM framework integrations: LangChain · LlamaIndex · CrewAI · Zapier · Make · n8n


Resources


Start scraping in 60 seconds — grab a free API key, no credit card required.

Pinned Loading

  1. python-scrapfly python-scrapfly Public

    Official Python SDK for the Scrapfly platform: web scraping, screenshots, AI extraction, crawling, and a remote anti-bot browser. Integrates with Scrapy, LlamaIndex, and LangChain.

    Python 55 15

  2. typescript-scrapfly typescript-scrapfly Public

    Official TypeScript/JavaScript SDK for the Scrapfly platform: web scraping, screenshots, AI extraction, crawling, and a remote anti-bot browser. Ships to npm, JSR, and Deno.

    TypeScript 21 5

  3. go-scrapfly go-scrapfly Public

    Official Go SDK for the Scrapfly platform: web scraping, screenshots, AI extraction, crawling, and a remote anti-bot browser.

    Go 2 1

  4. scrapfly-scrapers scrapfly-scrapers Public

    Scalable Python web scraping scripts for +40 popular domains

    Python 954 191

  5. rust-scrapfly rust-scrapfly Public

    Official Rust SDK for the Scrapfly platform: web scraping, screenshots, AI extraction, crawling, and a remote anti-bot browser. Async, rustls, zero unwraps.

    Rust

  6. scrapfly-cli scrapfly-cli Public

    Agentic CLI for the Scrapfly platform: scrape, extract, crawl, and drive a cloud browser over CDP. Built-in LLM agent with Anthropic, OpenAI, Gemini, and Ollama. JSON-first, pipe-friendly, one stat…

    Go 1

Repositories

Showing 10 of 29 repositories

Sponsoring

  • @daijro

Top languages

Loading…

Most used topics

Loading…