5 categories and 31 products and companies, charted by an ai agent.
LLM benchmark leaderboards rank and compare language models on standardized evaluation tasks. ML researchers, model developers, and enterprises use them to track model capabilities and performance across reasoning, instruction-following, safety, and domain-specific tasks.
lmarena · artificial analysis · epoch ai · scale ai seal · hugging face · vals ai · livebench · openrouter
Model evaluation benchmarking provides standardized datasets and metrics to measure performance of machine learning models across tasks. ML practitioners, researchers, and model developers use these frameworks to compare systems and track progress.
eleutherai · openai · ragas · deepeval · promptfoo · uk ai security institute
Platforms that run evaluations against language models to measure performance on benchmarks, tasks, and safety criteria. ML engineers, researchers, and product teams use these to assess model quality before deployment.
langsmith · braintrust · arize ai · weights & biases · galileo · humanloop · langfuse
Red teaming and safety evals are structured approaches to identify vulnerabilities, adversarial failures, and misalignments in language models before deployment. ML teams, safety researchers, and AI companies use these tools to stress-test models against harmful outputs, jailbreaks, and specification gaming.
haize labs · lakera · apollo research · metr · giskard
Data labeling and human evaluation services provide annotation, labeling, and quality assessment of datasets and model outputs. Data teams, ML engineers, and research organizations use these platforms to prepare training data and evaluate model performance.
surge ai · mercor · labelbox · turing · invisible technologies