100100 Ideas AI

bifrost

MCPOpen source

High-performance open-source AI gateway unifying 23+ LLM providers with failover, load balancing, and MCP support.

8.5kApache-2.0

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

Pros

+Extremely fast with <100µs overhead at 5k RPS, claimed 50x faster than LiteLLM
+Unified OpenAI-compatible API across 23+ providers with automatic failover and load balancing
+Built-in MCP gateway, semantic caching, guardrails, and observability (Prometheus, tracing)
+Zero-config deployment via npx or Docker with a web UI for monitoring and analytics

Cons

−Advanced enterprise features like adaptive load balancing, clustering, and guardrails may require a paid enterprise deployment
−Go-based codebase and plugin architecture add a learning curve for customization
−Feature depth can be overkill for simple single-provider projects

Target audience: Platform and backend engineers running production LLM workloads who need a fast, self-hosted multi-provider gateway with failover and governance.

Related tools

Other open-source tools that share tags with bifrost.

kong

MCPApache-2.0

Kong is a cloud-native API, LLM, and MCP gateway with high performance and extensible plugins.

44k·LLM Ops·Open source

Lua Nginx OpenResty Kubernetes Docker

Alternative to

Kong Konnect Apigee AWS API Gateway

OpenSandbox

MCPApache-2.0

Secure, fast, extensible sandbox runtime for AI agents with Docker/K8s support.

15k·AI Agents·Open source

Python Go TypeScript Java Kubernetes

Alternative to

E2B Modal Sandboxes Firecracker-based sandbox services

kubeshark

MCPApache-2.0

eBPF-powered Kubernetes network observability with TLS decryption, MCP integration for AI agents.

12k·Developer Tools·Open source

Go eBPF Kubernetes Docker Helm

Alternative to

Wireshark Kiali Pixie

tyk

MCPNOASSERTION

Open-source API and AI gateway supporting REST, GraphQL, gRPC, TCP and MCP with auth, rate limiting and analytics.

11k·MCP Servers·Open source

Go Docker Kubernetes Redis GraphQL

Alternative to

Kong Apigee AWS API Gateway MuleSoft

kubefwd

MCPApache-2.0

Bulk port forwarding Kubernetes services to localhost with unique IPs, TUI, and MCP support.

4.2k·Developer Tools·Open source

Go Kubernetes Docker

Alternative to

kubectl port-forward Telepresence mirrord

dagu

MCPGPL-3.0

Self-hostable workflow orchestrator with declarative YAML, single binary, no database, MCP support.

3.8k·LLM Ops·Open source

Go YAML Docker SSH Kubernetes

Alternative to

Airflow Cron Temporal