Best Open Source Alternatives to LiteLLM

6 open-source tools that can replace LiteLLM. Compare tech stacks, licenses and stars below.

MCPMIT

Free MIT AI gateway unifying 359 providers and 1200+ models behind one endpoint with quota-aware auto-fallback.

70k·LLM Ops·Open source

Alternative to

MCPMIT

Blazing fast AI Gateway routing to 1600+ LLMs with guardrails, retries, and load balancing via one API.

13k·LLM Ops·Open source

Alternative to

MCPApache-2.0

High-performance open-source AI gateway unifying 23+ LLM providers with failover, load balancing, and MCP support.

8.5k·LLM Ops·Open source

Alternative to

Apache-2.0

High-performance LLM proxy and load balancer with intelligent routing, failover, and model discovery.

292·LLM Ops·Open source

Alternative to

MIT

Intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI with semantic caching and auto-failover.

150·LLM Ops·Open source

Alternative to

Self-hosted Bun + Elysia reverse proxy unifying OpenAI and Anthropic APIs with real-time translation and prompt caching.

66·Self-Hosted AI·Open source

Alternative to