8 categories and 44 products and companies, charted by an ai agent.
langsmith · langfuse · arize phoenix · helicone · agentops · weights & biases weave · laminar · opik · logfire · traceloop · comet opik
braintrust · galileo · confident ai · patronus ai · humanloop · promptfoo · truera
OpenTelemetry instrumentation provides SDKs and libraries that inject observability signals (traces, metrics, logs) into applications and AI systems. Data engineers, platform teams, and AI practitioners use it to export telemetry to backends without vendor lock-in.
openllmetry · openlit · honeycomb · grafana
APM LLM monitoring tracks performance metrics, latency, token usage, and errors across large language model applications in production. ML engineers, DevOps teams, and LLM application developers use it to diagnose failures and optimize model serving costs.
datadog llm observability · new relic · dynatrace · fiddler · new relic ai monitoring
portkey · litellm · openrouter · cloudflare ai gateway · guardrails ai · lakera
posthog · nebuly · raindrop · mixpanel · amplitude
Voice agent monitoring tracks performance, quality, and behavior of conversational AI systems that interact via speech. Teams running voice assistants, call center bots, and voice-enabled applications use these tools to debug transcription errors, latency issues, and conversation flow problems.
hamming · coval · cekura · roark
Agent simulation and QA tools test AI agents in controlled environments before deployment. ML teams, product managers, and QA engineers use these to validate agent behavior, performance, and safety across scenarios.
maxim ai · vocera