10 categories and 68 products and companies, charted by an ai agent.
LLM API gateways route requests across multiple language model providers, load-balance traffic, and standardize API calls. Development teams, enterprises, and AI applications use them to avoid vendor lock-in and optimize costs and latency.
portkey · litellm · kong ai gateway · cloudflare ai gateway · helicone · truefoundry · vercel ai gateway · bifrost · nexos.ai · uplizd
openrouter · together ai · eden ai · aimlapi · requesty · trustedrouter · eurouter
Intelligent model routers direct API requests to different LLM providers based on cost, latency, capability, or availability criteria. Teams building AI applications use them to optimize inference spend and performance across multiple model endpoints.
not diamond · martian · unify · arch · routellm · nvidia llm router · yonoo
AI model routing gateways intelligently direct requests across multiple LLM providers and models based on cost, latency, or capability requirements. DevOps teams, ML engineers, and enterprises use these to manage traffic across heterogeneous model endpoints.
amazon bedrock · azure api management · databricks mosaic ai gateway · apigee
lakera · prompt security · cloudflare firewall for ai · f5 ai gateway · protect ai · guardrails ai · nemo guardrails · corrath
Open-source inference routers direct requests across multiple LLM models and providers, selecting which model processes each query. DevOps teams, ML engineers, and application developers use them to manage costs, latency, and model availability in production systems.
envoy ai gateway · vllm · gloo ai gateway
Multi-model chat apps route user conversations across multiple LLM providers and models, selecting which model handles each request. Product teams, enterprises, and individual users use them to access different AI models through one interface.
poe · typingmind · msty · t3 chat · perplexity · openweb ui · aitutor · talkory.ai · robowork · floutwork · anakin.ai
AI model routing and gateway platforms that direct requests across multiple LLM providers and models, used by developers and enterprises to manage inference across different APIs and optimize cost or latency.
fireworks ai · groq · deepinfra · cerebras · baseten
Cloud model hubs aggregate and route requests across multiple LLM providers and models through a single API endpoint. Teams building AI applications use these to avoid vendor lock-in, balance costs across providers, and switch models without code changes.
aws bedrock · azure ai foundry · google vertex ai · hugging face inference providers · databricks · databricks mosaic ai
LLM observability and evals tools monitor model behavior, latency, cost, and output quality across deployments. ML teams, platform engineers, and LLM application builders use these to track performance, catch regressions, and validate model responses in production.
langfuse · langsmith · braintrust · arize phoenix · weights & biases weave · arize · respan