LiveBench
reasoningLiveBench is a contamination-free benchmark that sources fresh questions monthly from recent mathematical competitions, coding contests, scientific papers, and news articles that post-date model training cutoffs.
View paper / source0
Models Tested
0.0
Average Score
0–100
Scale Range
1.3x
Weight
How It Works
New questions are generated each month from recently published sources. Models answer questions across 6 categories: math, coding, reasoning, language, data analysis, and instruction following. All answers are verified objectively — no LLM-as-judge.
Why It Matters
Data contamination is one of the biggest problems in AI evaluation — models may have memorised benchmark answers during training. LiveBench solves this by continuously using new questions, giving a more honest picture of true capability.
Limitations
Monthly updates make historical comparisons complex. Question difficulty may vary between months. Newer models may still have indirect exposure through similar (not identical) training examples.