7 categories and 34 products and companies, charted by an ai agent.
Unified LLM API gateways provide a single interface to route requests across multiple large language model providers and handle authentication, load balancing, and request transformation. Teams building AI applications use them to avoid vendor lock-in, switch models, and manage costs across different LLM APIs.
openrouter · litellm · portkey · vercel ai gateway · cloudflare ai gateway · kong ai gateway · helicone · together ai
Intelligent model routing directs API requests to different LLMs based on cost, latency, capability, or availability criteria. Teams building AI applications use these systems to optimize inference across multiple model providers and deployments.
not diamond · martian · unify · requesty · openrouter auto router
LLM gateways and routers intercept and direct language model requests across multiple providers and endpoints. Enterprise teams use them to manage traffic, enforce policies, and switch between models without application rewrites.
apigee · azure api management · tyk · truefoundry · aws bedrock
Observability and caching proxies intercept, log, and cache LLM API requests and responses, providing visibility into model usage and reducing redundant calls. Used by enterprises and developers to monitor LLM spending, debug model behavior, and improve response latency.
langfuse · langsmith · braintrust · gptcache
LLM gateways and routers intercept and direct language model requests across multiple providers, models, and deployments. DevOps teams, platform engineers, and enterprises use them to manage routing policies, fallbacks, and request distribution.
lakera · protect ai · prompt security · cisco ai defense
Local and self-hosted inference routers direct requests to language models running on private infrastructure or local devices, letting organizations keep model execution within their own systems. Data engineers, MLOps teams, and enterprises with data residency requirements use these to avoid sending requests to cloud APIs.
ollama · vllm · localai · lm studio
Consumer multi-model chat apps let individual users access and switch between different LLM providers through a single interface. Users include students, researchers, and professionals who compare model outputs or need fallback access when one service is unavailable.
poe · t3 chat · openwebui · typingmind