Humanity's Last Exam (tools) leaderboard
Humanity's Last Exam is a multidisciplinary set of expert-level questions built to resist the saturation that overtook MMLU. This column reports the tool-augmented mode, where the model may search and run tools while answering. That distinction is the whole story: the official maintainer leaderboards are closed-book by construction, evaluated text-only at temperature zero with searchable questions deliberately removed from the set so retrieval cannot substitute for knowledge. There is no separate with-tools dataset, paper, repository, or maintainer. It is a reporting mode, not a distinct benchmark, and the figures come from the labs themselves.
Last refreshed 2026-09-05. 12 models scored on this benchmark.
Full leaderboard
| # | Model | Provider | Score | Released |
|---|---|---|---|---|
| 1 | Claude Fable 5.1 | Anthropic | 65%vendor | 2026-09 |
| 2 | Claude Opus 5 | Anthropic | 64.7% | 2026-07 |
| 3 | Claude Fable 5 | Anthropic | 63.9% | 2026-06 |
| 4 | GLM-5.3 | Z.ai | 62.5%vendor | 2026-08 |
| 5 | Claude Opus 4.8 | Anthropic | 57.9% | 2026-05 |
| 6 | Claude Sonnet 5 | Anthropic | 57.4%vendor | 2026-06 |
| 7 | Qwen3.8 2.4T-A95B | Alibaba | 56.2%vendor | 2026-08 |
| 8 | Qwen3.8-Max | Alibaba | 56.2%vendor | 2026-08 |
| 9 | Kimi K3 | Moonshot AI | 56%vendor | 2026-07 |
| 10 | GLM-5.3 Flash | Z.ai | 55.3%vendor | 2026-08 |
| 11 | GLM-5.2 | Z.ai | 54.7%vendor | 2026-06 |
| 12 | Inkling | Thinking Machines | 46%vendor | 2026-07 |
Score interpretation
Never compare a with-tools score against a closed-book one. The gap is roughly ten points at the frontier, and it measures the tools, not the model. Because the HLE dataset is public, granting a model search access also lets it retrieve discussion of the questions themselves, which is exactly why the maintainers keep the official board closed-book. Treat every number in this column as vendor-reported and contamination-exposed, and treat the closed-book board as the cleaner measurement of what a model actually knows.
Why this matters for AI agents
Tool-augmented reasoning is how agents actually run in production, so this mode is closer to real deployment than the closed-book board. It is simply not a knowledge measurement. Read this column as an upper bound on what a model plus its retrieval stack can do on expert questions, and read closed-book HLE when you want to know what the weights themselves contain.
Other benchmarks
Premium API: time-series for Humanity's Last Exam (tools)
The leaderboard above is a snapshot. Want to see how a model's Humanity's Last Exam (tools) score has moved over the last 30-90 days, or set a webhook that fires when a score crosses a threshold? The premium API has both:
/api/premium/history/benchmarks/series?model=&benchmark=hle_tools: daily score evolution for one model on this benchmark, 1 credit per call