5 categories and 30 products and companies, charted by an ai agent.
Enterprise APM platforms that monitor application performance and now include LLM-specific instrumentation and tracing for AI-assisted applications. Used by DevOps teams, platform engineers, and SRE organizations running production systems that call large language models.
datadog · dynatrace · new relic · splunk · elastic observability · grafana cloud · honeycomb · sentry
LLM observability and tracing captures and visualizes the execution paths, token usage, latency, and errors of large language model applications and API calls. DevOps teams, ML engineers, and application developers use these tools to debug LLM-powered systems and monitor their behavior in production.
langsmith · arize phoenix · langfuse · helicone · weights & biases weave · braintrust
AI SRE and incident agents are software systems that detect, diagnose, and respond to incidents in production environments using LLM capabilities. DevOps teams, platform engineers, and SRE organizations use these tools to automate incident triage, root cause analysis, and remediation workflows.
pagerduty · incident.io · rootly · resolve ai · cleric · traversal
AIOps platforms that ingest observability data and use LLMs to identify root causes of incidents and anomalies. DevOps and SRE teams use these to accelerate incident diagnosis and reduce mean-time-to-resolution.
bigpanda · moogsoft · servicenow · logicmonitor · causely
LLM evaluation and guardrails platforms monitor language model outputs for safety, quality, and policy compliance. Enterprise teams use these to audit, test, and control LLM behavior in production applications.
galileo · patronus ai · deepchecks · fiddler ai · arthur ai