ollama-herd
MIT
Local AI load balancer for Ollama and MLX fleets with auto-discovery, smart routing, and OpenAI-compatible API.
20·LLM Ops·Open source
Alternative to
1 open-source tool that can replace Cloud AI APIs (e.g., OpenAI, Anthropic). Compare tech stacks, licenses and stars below.
Local AI load balancer for Ollama and MLX fleets with auto-discovery, smart routing, and OpenAI-compatible API.
Alternative to