Best Open Source Alternatives to Kong AI Gateway

2 open-source tools that can replace Kong AI Gateway. Compare tech stacks, licenses and stars below.

MCPMIT

Blazing fast AI Gateway routing to 1600+ LLMs with guardrails, retries, and load balancing via one API.

13k·LLM Ops·Open source

Alternative to

MIT

Intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI with semantic caching and auto-failover.

150·LLM Ops·Open source

Alternative to