LiveCodeBench

What it measures

Continuously updated contest problems for time-windowed code generation, execution, test prediction, and self-repair evaluation.

Primary metric

pass@1 on code generation (%)

Judge model

not judged by a model

Human baseline

—not reportedNo official aggregate human baseline is reported. Problems come from human programming contests with platform-specific participant statistics, which are not one comparable LiveCodeBench baseline.

Languages

English

Health

Scores are comparable only when leaderboard snapshot, release/date window, scenario, fast-versus-full tests, sampling, timeout, and language policy match. Timeline dates are model launch dates; all six scores belong to the August 2, 2026 leaderboard snapshot.

Status evidence

In the August 2, 2026 LiveCodeBench leaderboard snapshot, Qwen3.7 Max reaches 91.6%, Qwen3.7 Plus 89.6%, and GLM-4.7 84.9%; the leading cluster leaves too little reliable headroom for frontier ranking on this snapshot.

Saturated since

2026-08-02

Refresh cycle

continuous

Test set public

yes

Problems are collected after publication from LeetCode, AtCoder, and Codeforces; date-window filtering lets evaluators restrict tasks to those newer than a model's training cutoff.

Models scored on this benchmark

The reverse lookup, which is this site’s addition: every model here with a score on this benchmark. Independent measurements and vendor-reported numbers are kept apart rather than interleaved, because they are different claims.

No model on this site has a score on this benchmark yet. That usually means the models that were measured on it are not in the registry, rather than that nobody has run it.

Trajectory

Where results are tracked

Leaderboards benchwiki lists for this benchmark. These are links out, not sources this site ingests — no score below comes from any of them.

• LiveCodeBench official leaderboardofficial