8 categories and 48 products and companies, charted by an ai agent.
LLM observability platforms provide trace and span management for monitoring, debugging, and optimizing language model applications. Used by ML engineers, DevOps teams, and LLM application developers to track performance and troubleshoot issues.
langfuse · langsmith · arize phoenix · braintrust · opik · confident ai · helicone · honeyhive · weights & biases weave · comet opik
OpenTelemetry for AI provides trace and span management for monitoring AI/ML workloads, enabling developers and MLOps teams to observe model inference, training pipelines, and LLM application performance. It standardizes telemetry collection across AI systems to track latency, errors, and resource usage.
opentelemetry · openinference · traceloop · uptrace
Enterprise APM platforms with integrated LLM tracing capabilities that monitor and manage distributed traces and spans across applications, microservices, and AI/LLM components. Used by DevOps teams, SREs, and ML engineers to debug performance issues and understand AI system behavior.
datadog llm observability · new relic ai monitoring · dynatrace davis ai · coralogix · splunk ai agent monitoring · elastic observability
Tools for capturing, analyzing, and evaluating execution traces and spans in AI systems to debug and optimize agent behavior. Used by AI engineers, ML teams, and LLM application developers.
arize ai · weights and biases weave · deepeval · humanloop · patronus ai · galileo · whylabs · langwatch · maxim ai
Systems that store, index, and query distributed trace spans at scale for observability. Used by DevOps engineers, SREs, and platform teams managing microservices.
jaeger · zipkin · grafana tempo · clickhouse · openllmetry
Cost and token span analytics tools track API spending, token consumption, and latency across LLM requests to optimize cloud infrastructure expenses. Used by AI teams, DevOps engineers, and platform operators managing large-scale language model deployments.
portkey ai · lunary · log10 · vellum
Multi-agent trace stitching correlates and unifies distributed traces across multiple AI agents and services operating in parallel or sequence. Used by ML teams, platform engineers, and AI application developers managing complex agentic workflows.
controlflow · agentops · langtrace · autogen studio observability
Trace span management platforms capture, store, and query distributed trace spans from microservices and applications. DevOps teams, SREs, and platform engineers use these systems to debug latency, construct service dependency maps, and correlate requests across system boundaries.
datadog · new relic · dynatrace · honeycomb · lightstep · sentry