GPQA Diamond
reasoningGPQA Diamond (Graduate-Level Google-Proof Q&A) contains extremely difficult science questions that even domain experts find challenging. "Diamond" refers to the hardest subset where expert validators achieved less than 65% accuracy.
View paper / source5
Models Tested
93.2
Best Score
89.6
Average Score
0–100
Scale Range
1.5x
Weight
How It Works
Models answer open-ended graduate-level questions in physics, chemistry, and biology. Questions are designed to be "Google-proof" — they cannot be answered by simply searching the internet. Expert validators with PhDs in the relevant field verify question difficulty.
Why It Matters
GPQA Diamond is one of the most reliable indicators of deep scientific reasoning. Because even domain experts struggle with these questions, high scores genuinely indicate advanced reasoning capabilities rather than memorisation.
Limitations
Small dataset size (~200 questions) means scores can be noisy. Heavy STEM focus doesn't capture humanities or creative reasoning. Expert disagreement on some answers.
Leaderboard — GPQA Diamond
| # | Model | Provider | Score | |
|---|---|---|---|---|
| 🥇 | GPT-5.2 Pro (batch) | OpenAI | 93.2 | |
| 🥈 | GPT-5.2 (batch) | OpenAI | 92.4 | |
| 🥉 | Gemini 3 Pro | 91.9 | | |
| 4 | Claude Opus 4.5 (batch) | Anthropic | 87.0 | |
| 5 | Claude Sonnet 4.5 (batch) | Anthropic | 83.4 | |