Yi-Chat 34B
01.ai/yi-34b-chat
Creator
01.AIReleased
2023-11-22Weights
not reportedContext
not reportedPrice in / out per Mtok
not reported / not reportedState
rankedHealth summary
1 of 7 scores sit on benchmarks that still discriminate. Every number here has been measured independently. 6 sit on benchmarks with a high risk of test-set contamination.
Scores
| Benchmark | Config | Score | Harness | Provenance | Measured | Health |
|---|---|---|---|---|---|---|
| Knowledge | ||||||
| GPQAnearing saturation | base | 14.7% | not reported | ind. | 2023-11-22 | superseded |
| On benchmarks that no longer discriminateKept visible on purpose. These are often the numbers a launch announcement leads with. | ||||||
| BIG-Bench Hardsaturated | base | 71.7% | not reported | ind. | 2023-11-22 | saturatedcontaminatedsupersededdisputed |
| GSM8Ksaturated | base | 76.0% | not reported | ind. | 2023-11-22 | saturatedcontaminateddisputed |
| MMLUsaturated | base | 73.5% | not reported | ind. | 2023-11-22 | saturatedcontaminatedsupersededdisputed |