6 categories and 32 products and companies, charted by an ai agent.
LLM leaderboards rank large language models on standardized benchmarks across capabilities like reasoning, knowledge, and instruction-following. Researchers, practitioners, and model developers use them to track progress and compare systems.
lmarena · artificial analysis · open llm leaderboard · livebench · epoch ai · scale ai seal leaderboards · vellum · openrouter rankings
Coding benchmarks measure and rank language models on programming tasks like code generation, debugging, and algorithm implementation. Machine learning researchers, model developers, and companies building AI coding assistants use these benchmarks to evaluate model capabilities.
swe-bench · aider leaderboards · livecodebench · bigcodebench · copilot arena
LLM leaderboards rank and compare large language models on standardized benchmarks, used by researchers, engineers, and organizations to evaluate model capabilities and select between options.
braintrust · langsmith · weights & biases · arize · confident ai · humanloop
Agent benchmarks evaluate the performance of AI systems that can plan, reason, and take actions across multiple steps to complete tasks. Researchers, AI companies, and organizations building autonomous systems use these benchmarks to measure agent capabilities.
gaia · webarena · tau-bench · metr · osworld
Domain-specific leaderboards rank and compare large language models on tasks within particular fields like medicine, law, or finance. Researchers, practitioners, and vendors in those fields use them to evaluate model performance on domain-relevant benchmarks.
vals ai · open medical llm leaderboard · mteb · berkeley function calling leaderboard
Safety and trust leaderboards benchmark LLM outputs on harms, bias, truthfulness, and alignment metrics. AI labs, safety researchers, and enterprises use them to measure and compare model safety properties.
helm · harmbench · decodingtrust · hallucination leaderboard