14 categories and 66 products and companies, charted by an ai agent.
Crowd preference arenas are platforms where users vote, rank, and compare options to create benchmark leaderboards and community-driven rankings. Used by product teams, researchers, and communities to validate preferences and discover winners.
lmarena · scale labs leaderboard · wildguard arena · alpacaeval
Composite intelligence indexes aggregate and rank AI model performance across multiple benchmarks and dimensions, providing standardized comparison frameworks. Used by researchers, enterprises, and AI practitioners to evaluate and select models for deployment.
artificial analysis · llm stats · vellum leaderboard · datalearner · epoch ai benchmarks
swe-bench · tau2-bench · gaia benchmark · webarena · appbench · metr · humanity's last exam
humaneval · mbpp · bigcodebench · mirrorcode · terminal-bench
aime · arc-agi-2 · frontiermath · gpqa diamond · hle
osworld · osworld 2.0 · screenspot · ui-tars benchmark
vectara hallucination leaderboard · trustllm · salad-bench · halueval
mteb · beir · bright
Multimodal benchmark suites are standardized evaluation frameworks that test AI systems across multiple modalities (vision, language, audio) to measure their capabilities. Researchers, AI labs, and companies use them to compare model performance and track progress.
mmmu · mathvista · videomme · charxiv
LLM benchmark leaderboards rank language models on standardized tasks to measure capabilities across reasoning, coding, knowledge, and instruction-following. Researchers, practitioners, and model developers use these leaderboards to track progress and compare systems.
hugging face open llm leaderboard · livebench · scale ai seal leaderboards · epoch ai · vellum
Evaluation harnesses provide infrastructure and frameworks for running benchmarks, tests, and leaderboard competitions against AI models. ML researchers, model developers, and benchmark operators use them to execute standardized evaluations and track performance metrics.
eleutherai lm evaluation harness · inspect ai · openai evals · lighteval · deepeval · promptfoo
Platforms that run standardized tests against large language models and publish comparative rankings of model performance. ML researchers, model vendors, and procurement teams use these to track model capabilities over time.
langsmith · braintrust · arize phoenix · weights & biases weave · galileo · langfuse
Vertical domain leaderboards rank and compare AI models on benchmarks specific to narrow domains like medicine, law, or finance. Researchers, practitioners, and vendors in those domains use them to track model performance on task-specific datasets.
vals ai · berkeley function calling leaderboard · copilot arena · aider leaderboards
Tools that display ranked comparisons of consumer AI models across benchmarks and performance metrics. Researchers, developers, and enterprises use these to evaluate which models fit their use cases.
openrouter rankings · yupp · nano gpt · t3 chat