Best Open Source Alternatives to ScrapingBee

Open-source CLI giving AI agents free read/search access to Twitter, Reddit, YouTube, GitHub, Bilibili and more.

Open-source web crawler that turns any website into clean, LLM-ready Markdown for RAG and AI agents.

Stealth headless browser server for AI agents that bypasses Cloudflare and bot detection as a drop-in Puppeteer/Playwrig

Apify MCP server lets AI agents scrape social media, search engines, maps, and e-commerce sites via thousands of Apify A

Official Firecrawl MCP server for web scraping, search, and agent-ready context in AI clients.

MCP server for web search, scraping, structured data extraction, and browser automation for AI agents.

Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API