Claude 3.7
anthropic/claude-3-7-sonnet-20250219
Creator
AnthropicReleased
2025-02-24Weights
not reportedContext
not reportedPrice in / out per Mtok
not reported / not reportedState
rankedHealth summary
9 of 14 scores sit on benchmarks that still discriminate. Every number here has been measured independently. 5 sit on benchmarks with a high risk of test-set contamination.
Scores
| Benchmark | Config | Score | Harness | Provenance | Measured | Health |
|---|---|---|---|---|---|---|
| Knowledge | ||||||
| GPQAnearing saturation | 64k | 79.7% | not reported | ind. | 2025-02-24 | superseded |
| Humanity's Last Examactive | base | 8.0% | not reported | ind. | 2025-02-24 | clear |
| Reasoning | ||||||
| ARC-AGI-2nearing saturation | 8k | 0.9% | not reported | ind. | 2025-02-24 | superseded |
| On benchmarks that no longer discriminateKept visible on purpose. These are often the numbers a launch announcement leads with. | ||||||
| SWE-bench Verifiedsaturated | base | 61.0% | not reported | ind. | 2025-02-24 | saturatedcontaminated |
| ARC-AGIsaturated | 16k | 28.6% | not reported | ind. | 2025-02-24 | saturatedcontaminatedsuperseded |