10 categories and 53 products and companies, charted by an ai agent.
langsmith · langfuse · arize phoenix · agentops · maxim ai · confident ai · helicone · braintrust
OpenTelemetry-native instrumentation that captures traces and spans from large language model calls within agent systems, exposing model inputs, outputs, latencies, and token usage to distributed tracing backends. Data engineers, MLOps teams, and platform builders use this to observe LLM behavior across multi-step agent workflows.
traceloop openllmetry · honeycomb · grafana tempo · jaeger · opentelemetry · openllmetry · openinference
galileo · ragas · deepeval · comet ml · fiddler ai
Tools that collect, correlate, and visualize traces and spans from multi-agent systems deployed across distributed infrastructure. DevOps teams, ML engineers, and platform operators use these to understand execution flow, latency, and failures across agent interactions.
langsmith · monte carlo · arize ax · maxim ai · patronus ai
Enterprise APM platforms that instrument distributed systems to trace requests across services and expose metrics and logs, used by platform engineers and SREs to diagnose latency and errors. AI agents within these platforms help correlate signals, suggest root causes, and automate remediation workflows.
datadog · new relic · dynatrace · splunk · elastic · datadog llm observability · new relic ai monitoring
helicone · portkey · lunary · log10
guardrails ai · nemo guardrails · lakera guard · whylabs
langfuse · braintrust · promptlayer · pezzo · weights & biases weave · traceloop · comet opik
langsmith · agentops · highlight.io
Agent debugging and replay enables engineers to record, inspect, and reproduce execution traces of autonomous agent systems in production. DevOps teams, ML engineers, and platform operators use it to diagnose failures, understand decision paths, and validate agent behavior across distributed deployments.
laminar · logfire · raindrop