5 categories and 29 products and companies, charted by an ai agent.
LLM tracing platforms capture and visualize the execution flow of language model applications, showing token usage, latency, and intermediate steps. ML engineers, application developers, and DevOps teams use these to debug agent behavior and monitor production LLM systems.
langsmith · langfuse · arize phoenix · helicone · braintrust · weights & biases weave · comet opik · traceloop · agentops
OpenTelemetry instrumentation provides SDKs and agents that inject observability code into applications to collect traces, metrics, and logs. Platform engineers, DevOps teams, and SREs use it to instrument their services for downstream analysis.
opentelemetry · openllmetry · openinference · pydantic logfire · jaeger
Agent observability and tracing captures execution traces, decisions, and tool calls from autonomous agents to help engineers debug behavior and understand system flow. Data engineers, ML engineers, and application developers building with LLM agents use these tools to inspect what their agents are doing.
galileo · patronus ai · confident ai · humanloop · promptfoo · maxim ai
Gateway-based monitoring observes and traces requests passing through API gateways, service meshes, and ingress controllers without instrumenting application code. Platform engineers and SREs use it to track distributed requests across service boundaries.
portkey · litellm · cloudflare ai gateway · openrouter
APM platforms that integrate LLM observability features to trace and monitor AI agent interactions alongside traditional application performance. DevOps teams, ML engineers, and platform operators use these to debug agent behavior and performance across distributed systems.
datadog llm observability · new relic · dynatrace · grafana · honeycomb