AIME

What it measures

The MAA's competition exam — 15 integer-answer problems per test, refreshed yearly so each new exam is briefly contamination-free.

Primary metric

accuracy — every answer is an integer 000–999, exact match (%)

Judge model

not judged by a model

Human baseline

33The line is the median AIME score, ~5 out of 15 (≈33%): 2024 AIME I had median 5 / mean 5.89, AIME II median 5 / mean 5.45. The crucial context, unlike MATH's 'which human' range: AIME takers are ALREADY an elite pool — the top ~5% of AMC qualifiers — and even they median only a third of the exam; a perfect 15/15 is achieved by only a few students per exam. So the baseline is LOW even for excellent humans, which is exactly what made frontier models scoring 90%+ so striking. (Note: the gauge shades 'above baseline' as its saturation zone; for AIME that region reads as 'above the median qualifier', not 'near the 100% ceiling' — the true ceiling is a perfect score, which top humans do reach.)

Languages

English

Health

This is the sharpest sample-size trap on the wiki. One AIME exam is 15 questions, so ONE question = 6.7 points; a full year (30 questions, both exams) is 3.3 points per question. A 'model A beats model B by one question' gap is essentially noise — which is the entire reason labs run heavy sampling (avg@k / maj@64) instead of a single pass. Never trust a small AIME gap, and never compare a single-sample number against an avg@64 one.

Status evidence

AIME's status is genuinely split by its yearly refresh. OLD exams are saturated and contaminated: reasoning models solved AIME 2024 (o3 ~96.7%, up from GPT-4o's 13.4%). Each FRESH exam has a shrinking clean window, but frontier models now score high even on fresh exams (AIME 2025 ~85–91%). So the rolling benchmark is nearing-saturation — no single exam discriminates for long, yet the yearly refresh keeps briefly-clean signal alive. The plotted gauge/timeline is the AIME 2024 progression (one exam); the perpetual benchmark's yearly reset is described in prose, since the signature gauge shows one monotonic climb and cannot depict a reset.

Saturated since

not saturated

Refresh cycle

yearly

Test set public

yes

AIME is the wiki's first benchmark where REFRESH is the contamination defense — the concrete illustration of the yearly-refresh strategy the GSM8K and MATH pages point toward. Each new exam is genuinely unseen at release (a real, brand-new competition), giving a brief clean measurement window. But within months the problems and worked solutions flood the web, so that year's exam becomes contaminated: AIME 2024 is now high-contamination, while a current-year exam is briefly clean. The defense is rolling, not permanent — which is why risk is 'medium' (fresh yearly, decays fast), not low (no exam stays clean) or high (there is always a fresh, uncontaminated exam to run).

Models scored on this benchmark

The reverse lookup, which is this site’s addition: every model here with a score on this benchmark. Independent measurements and vendor-reported numbers are kept apart rather than interleaved, because they are different claims.

No model on this site has a score on this benchmark yet. That usually means the models that were measured on it are not in the registry, rather than that nobody has run it.

Trajectory

Where results are tracked

Leaderboards benchwiki lists for this benchmark. These are links out, not sources this site ingests — no score below comes from any of them.

• MathArena (canonical live tracker)official
• Artificial Analysis (AIME)third-party