Inference gateways, routing & control
Infrastructure that connects applications with model providers and provides a shared control layer for production inference.
- Companies
- 14
Explore
Companies
- Concentrate AI
Concentrate AI builds an LLM gateway that gives teams one API for multiple model providers, with routing, failover, logging, spend controls, and access governance for production inference…
- ContextLane
ContextLane provides a self-hosted AI gateway that routes requests to approved models based on task needs and company policy, helping teams control inference costs.
- Helicone
Helicone is an AI gateway and LLM observability platform for developers that provides a unified API plus logging, monitoring, routing, caching, and cost/performance analytics across model…
- LiteLLM
LiteLLM is an open source AI gateway and proxy that gives teams one interface to route, control, and monitor requests across many model providers.
- Maxim AI
Maxim AI builds an enterprise AI evaluation, observability, and gateway platform that helps teams route, govern, test, and monitor production AI applications.
- Not Diamond
Not Diamond builds an intelligent AI model router and prompt optimization platform that helps developers route requests across multiple models to improve quality while reducing inference cost and…
- OpenRouter
OpenRouter is an AI gateway and model marketplace that lets developers and enterprises route requests across hundreds of LLMs through a single API with built-in reliability, pricing, and fallback…
- Portkey
Portkey is an AI gateway and control-plane platform that gives developers and enterprises one unified layer for routing, observability, guardrails, and governance across multiple model providers.
- Requesty
Requesty is an AI gateway and LLM router that gives teams a single OpenAI-compatible endpoint to access 600+ models with routing, fallbacks, caching, governance, observability, and spend controls…
- Respan
Respan is an AI engineering platform for LLM and agent products that provides routing, observability, evaluations, and control for production inference. (respan.ai)
- Thesean
Thesean is an AI inference research lab incubated by Martian. Its first product, Ship, is a best-execution endpoint that aims to reduce frontier-model inference cost while preserving model…
- TrueFoundry
TrueFoundry builds an enterprise AI gateway and deployment platform that gives teams a shared control layer for routing, governing, and observing model and agent traffic in production.
- TrustedRouter
TrustedRouter is an AI routing company that gives developers one OpenAI compatible API for models from multiple providers, with controls for price, reliability, region, and privacy posture.
- Weflayr
Weflayr builds an AI gateway that routes each request to the most suitable model based on benchmarks, business context, cost, and quality.