olla
Apache-2.0
High-performance LLM proxy and load balancer with intelligent routing, failover, and model discovery.
292·LLM Ops·Open source
Best Open Source Alternatives to Nginx
1 open-source tool that can replace Nginx. Compare tech stacks, licenses and stars below.