Skip to content
LLM Atlas

Leaderboard

LLaMA-3.1 405B Base

meta-ai/llama-3.1-405b

Compare with…
Creator
Meta AI
Released
2024-07-23
Weights
not reported
Context
not reported
Price in / out per Mtok
not reported / not reported
State
ranked

Health summary

0 of 4 scores sit on benchmarks that still discriminate. Every number here has been measured independently. 4 sit on benchmarks with a high risk of test-set contamination.

Epoch Capability Index

128.8 (123.5–130.7)

Epoch AI's Capability Index. A composite score with no benchmark health record behind it, so it is never this site's ranking basis and is always attributed. Published by Epoch AI under CC BY 4.0. fetched 2026-10-19

Scores

BenchmarkConfigScoreHarnessProvenanceMeasuredHealth
On benchmarks that no longer discriminateKept visible on purpose. These are often the numbers a launch announcement leads with.
BIG-Bench Hardsaturatedbase82.9%not reportedind.2024-07-23saturatedcontaminatedsuperseded
HellaSwagsaturatedbase89.2%not reportedind.2024-07-23saturatedcontaminated
MMLUsaturatedbase84.4%not reportedind.2024-07-23saturatedcontaminatedsuperseded
WinoGrandesaturatedbase89.2%not reportedind.2024-07-23saturatedcontaminated