ruflo
MCPMIT
Ruflo is an open-source agent meta-harness for deploying AI swarms, coordinating workflows, and building conversational
68k·AI Agents·Open source
spider
MCPOpen sourceFast Rust web crawler & scraper for AI agents, LLMs, and RAG pipelines.
2.7kMIT
Get web data for AI agents and LLMs - fast, efficient, and reliable with Rust
Pros
- +High-performance concurrency-first crawling in Rust
- +Streams pages as they arrive, with smart JavaScript rendering
- +Scales from local script to distributed fleet or managed cloud
- +Provides MCP server for AI agents
Cons
- −Requires Rust knowledge for advanced customization
- −Managed cloud service may incur costs
- −Headless Chrome support adds complexity
Target audience: Developers building AI agents, LLM pipelines, or web scraping tools needing high-speed, reliable data extraction.
Related tools
Other open-source tools that share tags with spider.
FlyEnv
MCPBSD-3-Clause
Native local dev environment for macOS, Windows & Linux with runtimes, databases, servers, HTTPS, and MCP support.
3.2k·Developer Tools·Open source
Alternative to
Free MIT curriculum with 523 lessons to learn, build, and ship AI agents, LLM apps, and MCP servers from scratch.
56k·Developer Tools·Open source
Alternative to
goose
MCPApache-2.0
Open source AI agent for code, workflows, and automation with desktop, CLI, and API.
53k·AI Agents·Open source
Alternative to
UI-TARS-desktop
MCPApache-2.0
Open-source multimodal AI agent stack with GUI automation, CLI, and desktop app.
39k·AI Agents·Open source
composio
MCPMIT
Composio: 1000+ pre-authenticated toolkits, sessions, auth, and sandbox for building AI agents.
30k·AI Agents·Open source