MathArena

What it measures

A continuously refreshed platform evaluating models on newly released math competitions, proofs, research problems, and formalization.

Primary metric

expected performance across non-deprecated competitions (%)

Judge model

not judged by a model

Human baseline

—not reportedNo single human aggregate is meaningful across age-group contests, AIME, IMO proofs, university competitions, Project Euler, recent research questions, and formalization tracks.

Languages

English

Health

Each competition is small and the benchmark membership changes. Use the site's uncertainty intervals and date-stamp every aggregate; per-competition scores are more interpretable than the cross-platform IRT summary.

Status evidence

MathArena continuously adds newly released competitions and research-derived tasks; even as aggregate expected performance rises, fresh proof, visual, and research tracks preserve measurable headroom.

Saturated since

not saturated

Refresh cycle

continuous

Test set public

yes

Models are evaluated immediately after new competition problems are released, before they can plausibly enter subsequent training runs; later public exposure does not preserve cleanliness forever.

Models scored on this benchmark

The reverse lookup, which is this site’s addition: every model here with a score on this benchmark. Independent measurements and vendor-reported numbers are kept apart rather than interleaved, because they are different claims.

No model on this site has a score on this benchmark yet. That usually means the models that were measured on it are not in the registry, rather than that nobody has run it.

Trajectory

Where results are tracked

Leaderboards benchwiki lists for this benchmark. These are links out, not sources this site ingests — no score below comes from any of them.

• Official MathArena platformofficial