dify
MCPNOASSERTION
Open-source LLM app development platform for building AI workflows, RAG pipelines, and agents.
153k·LLM Ops·Open source
Scrapling
MCPOpen sourceAdaptive web scraping framework with anti-bot bypass, auto-relocating selectors, and scalable crawling.
75kBSD-3-Clause
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!
Pros
- +Adaptive selectors that auto-relocate when website structure changes
- +Built-in anti-bot bypass for Cloudflare Turnstile
- +Supports both sync and async fetching, plus stealth and dynamic modes
- +Scalable spider framework with pause/resume and proxy rotation
Cons
- −Primarily Python-only, limiting use in other language ecosystems
- −Advanced features may require understanding of async programming
- −Documentation may be overwhelming for beginners
Target audience: Python developers and data engineers who need robust, scalable web scraping with anti-bot evasion and adaptive parsing.
Related tools
Other open-source tools that share tags with Scrapling.
open-webui
MCPNOASSERTION
Self-hosted AI platform with chat UI, RAG, plugins, and multi-model support.
150k·Self-Hosted AI·Open source
Alternative to
crawl4ai
MCPApache-2.0
Open-source web crawler that turns any website into clean, LLM-ready Markdown for RAG and AI agents.
84k·Developer Tools·Open source
Alternative to
worldmonitor
MCPAGPL-3.0
Open-source real-time global intelligence dashboard with AI news aggregation, geopolitical monitoring, and infrastructur
83k·MCP Servers·Open source
Alternative to
headroom
MCPApache-2.0
Open-source context compression layer for AI agents, cutting tokens 60-95% for JSON and 15-20% for coding.
67k·LLM Ops·Open source
TrendRadar
MCPGPL-3.0
AI-driven multi-platform trend & opinion monitor with RSS, smart alerts, and MCP support.
62k·MCP Servers·Open source