What's new
now jobs Jobs market snapshot refreshed now data Recomputed benchmark-weighted quality scores now data Synced Chatbot Arena benchmark track now data Updated speed measurements now data Pulled latest OpenRouter price index now data Validated official pricing snapshots 23h digest An Anthropic researcher just gave us a peek at self-improving AI 23h digest Neocloud Lambda secures $1B in debt to buy more chips 23h digest Open-weight AI companies are the Valley’s hottest acquisition targets 23h digest Published the 2026-08-28 daily digest now jobs Jobs market snapshot refreshed now data Recomputed benchmark-weighted quality scores now data Synced Chatbot Arena benchmark track now data Updated speed measurements now data Pulled latest OpenRouter price index now data Validated official pricing snapshots 23h digest An Anthropic researcher just gave us a peek at self-improving AI 23h digest Neocloud Lambda secures $1B in debt to buy more chips 23h digest Open-weight AI companies are the Valley’s hottest acquisition targets 23h digest Published the 2026-08-28 daily digest
AI Concepts

Benchmark

Definition

A standardised test used to evaluate and compare AI model performance. Common benchmarks include MMLU (general knowledge), GPQA (graduate-level science), HumanEval (coding), and MATH (mathematical reasoning). Benchmarks enable objective comparison between models.

In Plain English

A standardised exam for AI models. Just like students take SATs to compare performance, AI models take benchmarks. A model scoring 90% on MMLU means it answered 90% of a massive multiple-choice knowledge test correctly.

All Glossary Terms