Best Open Source Alternatives to Portkey

4 open-source tools that can replace Portkey. Compare tech stacks, licenses and stars below.

MCPMIT

Free MIT AI gateway unifying 359 providers and 1200+ models behind one endpoint with quota-aware auto-fallback.

70k·LLM Ops·Open source

Alternative to

MCPApache-2.0

High-performance open-source AI gateway unifying 23+ LLM providers with failover, load balancing, and MCP support.

8.5k·LLM Ops·Open source

Alternative to

MIT

Intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI with semantic caching and auto-failover.

150·LLM Ops·Open source

Alternative to

Self-hosted Bun + Elysia reverse proxy unifying OpenAI and Anthropic APIs with real-time translation and prompt caching.

66·Self-Hosted AI·Open source

Alternative to