100100 Ideas AI
Submit Tool

webclaw

MCPOpen source

Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API

2.3kAGPL-3.0

Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.

Pros

  • +High-performance Rust-based extraction engine
  • +Local-first with CLI, REST API, and MCP server
  • +Supports crawling, structured data extraction, and brand asset extraction
  • +Easy installation via Homebrew, Docker, or npx

Cons

  • −Requires native build tools if compiling from source
  • −May need proxy configuration for some sites
  • −Self-hosting requires setup and maintenance

Target audience: Developers and AI engineers building LLM applications, RAG pipelines, or AI agents that need clean, structured web content.

Related tools

Other open-source tools that share tags with webclaw.

ECC

MCPMIT

Open-source agent harness performance optimization system with skills, memory, and security for AI coding tools.

243k·Developer Tools·Open source