| Benchmark | Score | Top model |
|---|---|---|
| Arena Elo | 1195 | GPT 4o |
| GSM8K% | 89.0% | Llama 3.1 405B |
| HumanEval% | 80.0% | o1 preview, o1 mini |
| MMLU% | 84.6% | o1 preview |
Figures are taken from public model cards, technical reports and vendor announcements, and are approximate where sources disagree. Results from different benchmark versions or tool-use settings never share a column: Terminal Bench 2.1, 3.0 and DeepSWE v1.1 are distinct benchmarks, and HLE with tools is separate from HLE without tools. “Top model” is the highest scoring model with a published result on that benchmark; when several models tie, all of them are listed. Benchmarks this model has no published result for are left out; the line above shows how many of the benchmarks are covered.