4 categories and 25 products and companies, charted by an ai agent.
LLM leaderboards rank large language models on standardized benchmarks across reasoning, knowledge, and instruction-following tasks. Researchers, engineers, and product teams use them to track model capability progress and select models for deployment.
lmarena · artificial analysis · hugging face open llm leaderboard · epoch ai · livebench · openrouter rankings · scale ai seal leaderboards · vellum
Coding and agent benchmarks measure the performance of AI systems on programming tasks, code generation, and autonomous agent behavior. Machine learning researchers, AI companies, and developers use these benchmarks to evaluate model capabilities on tasks like code completion, bug fixing, and multi-step reasoning.
swe-bench · terminal-bench · aider polyglot · metr · webarena
Platforms that rank and compare AI models, systems, or agents across standardized test suites. Researchers, engineers, and product teams use them to track performance, identify gaps, and choose models for deployment.
braintrust · langsmith · arize ai · weights & biases weave · galileo · humanloop · promptfoo
Domain-specific benchmarks are curated test suites that measure AI system performance on specialized tasks within particular fields—law, medicine, science, finance. Researchers, model developers, and enterprises use them to evaluate capability and readiness in vertical domains.
vals ai · mteb · gpqa · humanity's last exam · arc prize