INTELLECT-1-Instruct
prime-intellect-hugging-face-arcee-ai/intellect-1-instruct
Creator
Prime Intellect,Hugging Face,Arcee AIReleased
2024-11-29Weights
not reportedContext
not reportedPrice in / out per Mtok
not reported / not reportedState
rankedHealth summary
0 of 5 scores sit on benchmarks that still discriminate. Every number here has been measured independently. 5 sit on benchmarks with a high risk of test-set contamination.
Scores
| Benchmark | Config | Score | Harness | Provenance | Measured | Health |
|---|---|---|---|---|---|---|
| On benchmarks that no longer discriminateKept visible on purpose. These are often the numbers a launch announcement leads with. | ||||||
| BIG-Bench Hardsaturated | base | 34.8% | not reported | ind. | 2024-11-29 | saturatedcontaminatedsuperseded |
| GSM8Ksaturated | base | 38.6% | not reported | ind. | 2024-11-29 | saturatedcontaminated |
| HellaSwagsaturated | base | 71.4% | not reported | ind. | 2024-11-29 | saturatedcontaminated |
| MMLUsaturated | base | 49.9% | not reported | ind. | 2024-11-29 | saturatedcontaminatedsuperseded |
| WinoGrandesaturated | base | 65.8% | not reported | ind. | 2024-11-29 | saturatedcontaminated |