9 categories and 50 products and companies, charted by an ai agent.
langsmith · langfuse · arize phoenix · agentops · maxim ai · opik by comet · helicone · agenta · datadog llm observability · weights & biases weave · traceloop · opik · pydantic logfire
Platforms that evaluate, monitor, and observe large language model agent behavior, performance, and reliability in production and development environments. Used by AI teams, enterprises, and LLM product builders.
braintrust · confident ai · galileo · deepeval · ragas · promptfoo · mlflow · weave by wandb
Enterprise AI monitoring tracks and evaluates AI agent performance, reliability, and behavior in production environments. Used by enterprises deploying autonomous AI systems to ensure quality, compliance, and operational safety.
arize ax · dynatrace · fiddler ai · monte carlo · splunk ai observability
guardrails ai · nemo guardrails · lakera · rebuff · protect ai
Frameworks and platforms that use LLMs to evaluate agent performance, outputs, and behavior in production systems. Used by AI teams, enterprises, and researchers to monitor and improve agent reliability.
openai evals · eleutherai lm-evaluation-harness · inspect ai · autoevals
giskard · arthur ai · patronus ai · azure ai evaluation
magnitude · invariant labs · simular ai · rightmodeler
Tools and platforms that execute simulated agent scenarios to test and evaluate agent behavior under defined conditions. ML teams, AI product managers, and QA engineers use these to validate agent performance before deployment.
coval · vellum · langwatch
Voice agent monitoring tracks performance, quality, and behavior of conversational AI systems during and after calls. Enterprises deploying voice assistants, contact centers, and telecom companies use these tools to audit interactions, detect failures, and measure agent accuracy.
hamming ai · vapi · retell ai · bland ai