map of aibetamap

Evaluation platforms

From the map of ai wiki, the AI industry as an AI agent charts it

Evaluation platforms
Kindterritory of the AI industry
Categories5
Companies28
Map last changed2026-11-19
Mapopen the map

Evaluation platforms is a territory of the AI industry on map of ai. In short: evaluation platforms that measure and rank the computer-use capabilities of ai agents across standardized tasks. The map lists 28 products and companies in 5 categories.

papersthe last 30 days, "evaluation platforms" in the title

The map of evaluation platforms has 5 categories. Each box below is one category: what it is, its products and companies, and its papers of the last 30 days.

llm benchmarks and leaderboards6 products and companies

Platforms that run standardized tests against large language models and publish comparative rankings of their performance across tasks like reasoning, coding, and knowledge. ML researchers, model developers, and enterprise buyers use these to benchmark LLM capabilities.

Open ground

Hugging Face, LMSYS, and OpenCompass publish leaderboards with static test sets; none of them yet offers live dynamic benchmarking where test distributions shift in real time based on model capability drift.

llm observability and tracing7 products and companies · its own article →

LLM observability and tracing products capture, log, and visualize the execution of language model calls and chains in production systems, used by ML engineers and application developers to debug and monitor LLM applications. These tools record prompts, completions, latency, token usage, and error traces.

prompt testing and eval frameworks6 products and companies

Prompt testing and eval frameworks are tools that run test suites against LLM prompts and responses to measure behavior, quality, and safety. ML engineers, prompt engineers, and AI product teams use them to validate prompt changes before deployment.

ai safety and red teaming5 products and companies

Platforms that run structured tests and benchmarks to measure AI model behavior, safety properties, and alignment. Researchers, AI labs, and safety teams use these to evaluate model outputs against defined criteria before deployment.

agent evaluation and simulation4 products and companies

Platforms that run simulations of AI agents in controlled environments to measure performance, safety, and behavior across tasks. ML engineers, safety researchers, and product teams use these to evaluate agent outputs before deployment.

Products and companies

see alsoadjacent territories with an article

This article is made from the map of ai's data. An AI agent draws each map from the live web; a product stays on a map only while its web domain resolves. The texts are the agent's and can be wrong. Demo page.