6 categories and 33 products and companies, charted by an ai agent.
LLM tracing and debugging tools capture and analyze the execution flow, intermediate states, and decisions within language model applications and agent workflows. ML engineers, platform teams, and application developers use these tools to understand model behavior, diagnose failures, and optimize prompt chains.
langsmith · langfuse · arize phoenix · helicone · traceloop · weights & biases weave · logfire · opik
Agent observability tools collect and surface logs, traces, and metrics from AI agents during execution. Data engineers, ML ops teams, and AI platform builders use these tools to debug agent behavior, monitor performance, and diagnose failures in production.
braintrust · confident ai · galileo · patronus ai · humanloop · promptfoo
Agent observability tracks the behavior, performance, and correctness of AI agents during execution. ML engineers, platform teams, and AI product managers use it to monitor agent actions, tool calls, reasoning steps, and outcomes in production.
datadog llm observability · dynatrace · new relic · fiddler ai · arize ax · honeycomb
AI gateways and proxies route and manage requests to language models and agent systems, mediating between applications and backend inference endpoints. DevOps teams, platform engineers, and AI infrastructure operators use them to control traffic, enforce policies, and observe model interactions.
portkey · litellm · openrouter · cloudflare ai gateway · kong
Agent session replay and analytics captures and analyzes recorded interactions, logs, and performance metrics from deployed AI agents to enable debugging, compliance review, and performance optimization. Contact centers, enterprise AI operations teams, and developers use these tools to inspect what agents did during customer interactions.
agentops · raindrop · posthog · langwatch
Voice agent testing and monitoring tools that track performance, quality, and behavior of conversational AI systems in production. Used by enterprises and developers running voice-based customer service, IVR, and voice assistant applications.
hamming ai · coval · cekura · vocera