Falcon 40B
technology-innovation-institute/falcon-40b
Creator
Technology Innovation InstituteReleased
2023-03-15Weights
not reportedContext
not reportedPrice in / out per Mtok
not reported / not reportedState
rankedHealth summary
0 of 11 scores sit on benchmarks that still discriminate. Every number here has been measured independently. 11 sit on benchmarks with a high risk of test-set contamination.
Epoch Capability Index
104.5 (95.0–110.2)
Epoch AI's Capability Index. A composite score with no benchmark health record behind it, so it is never this site's ranking basis and is always attributed. Published by Epoch AI under CC BY 4.0. fetched 2026-10-19
Scores
| Benchmark | Config | Score | Harness | Provenance | Measured | Health |
|---|---|---|---|---|---|---|
| On benchmarks that no longer discriminateKept visible on purpose. These are often the numbers a launch announcement leads with. | ||||||
| BIG-Bench Hardsaturated | base | 37.1% | not reported | ind. | 2023-03-15 | saturatedcontaminatedsuperseded |
| GSM8Ksaturated | base | 25.0% | not reported | ind. | 2023-03-15 | saturatedcontaminateddisputed |
| HellaSwagsaturated | base | 85.3% | not reported | ind. | 2023-03-15 | saturatedcontaminateddisputed |
| MMLUsaturated | base | 56.9% | not reported | ind. | 2023-03-15 | saturatedcontaminatedsupersededdisputed |
| WinoGrandesaturated | base | 76.9% | not reported | ind. | 2023-03-15 | saturatedcontaminateddisputed |