12 categories and 70 products and companies, charted by an ai agent.
LLM API gateways manage, route, and control traffic to large language model APIs, protecting against abuse and optimizing requests. Used by enterprises, developers, and AI platforms to standardize access and monitor usage across multiple LLM providers.
kong ai gateway · cloudflare ai gateway · litellm · portkey · braintrust gateway · zuplo · truefoundry · apache apisix · bifrost (maxim ai) · aisix (api7) · f5 nginx ai gateway · vercel ai gateway · requesty
litellm router · openrouter · martian · unify ai · not diamond · redis langcache
helicone · langfuse · lunary · portkey (cost module) · keywordsai
gptcache · zep · momento ai cache · cloudflare ai cache
kong rate limiting plugin · apilayer · zuplo rate limit · aws api gateway throttling
langsmith · helicone · arize phoenix · langfuse · traceloop · honeycomb ai · parea ai · arize · datadog llm observability · braintrust
guardrails ai · nvidia nemo guardrails · lakera guard · aporia · prompt armor
AI Gateway Traffic Control manages routing, load balancing, and request orchestration across multiple AI models and endpoints. Used by enterprises, AI platforms, and service providers to optimize inference workloads and control costs.
langchain · llamaindex · fixie ai · superagent · temporal ai
Cloud-native AI traffic management encompasses intelligent routing, load balancing, and request orchestration for AI/ML workloads and LLM APIs in distributed environments. Used by enterprises deploying AI services at scale, DevOps teams, and platform engineers managing multi-model inference infrastructure.
aws bedrock agentcore · azure ai foundry · google vertex ai gateway · ibm watsonx
Cloud edge gateways route and manage AI traffic between cloud services and edge infrastructure, handling inference requests at network edges. Used by enterprises, telecom operators, and cloud providers to reduce latency and bandwidth for AI workloads.
aws bedrock · azure api management · google apigee · fastly · nginx
AI security guardrails filter, block, or modify prompts and responses to enforce content policies, detect injection attacks, and prevent misuse. Used by enterprises, AI platform operators, and service providers integrating LLM applications.
lakera · protect ai · prompt security · noma security · cisco ai defense
MCP gateways route and manage traffic between AI applications and multiple model context protocol servers, allowing developers and enterprises to distribute requests across heterogeneous backend services. Used by teams building multi-model applications, agentic systems, and distributed AI infrastructure.
docker mcp gateway · smithery · composio · mintmcp