GPT-3
openai/text-davinci-001
Creator
OpenAIReleased
2022-01-27Weights
not reportedContext
not reportedPrice in / out per Mtok
not reported / not reportedState
rankedHealth summary
0 of 8 scores sit on benchmarks that still discriminate. Every number here has been measured independently. 8 sit on benchmarks with a high risk of test-set contamination.
Scores
| Benchmark | Config | Score | Harness | Provenance | Measured | Health |
|---|---|---|---|---|---|---|
| On benchmarks that no longer discriminateKept visible on purpose. These are often the numbers a launch announcement leads with. | ||||||
| HellaSwagsaturated | base | 79.3% | not reported | ind. | 2022-01-27 | saturatedcontaminateddisputed |
| MMLUsaturated | base | 43.9% | not reported | ind. | 2022-01-27 | saturatedcontaminatedsuperseded |
| SuperGLUEsaturated | base | 71.8% | not reported | ind. | 2022-01-27 | saturatedcontaminated |
| WinoGrandesaturated | base | 77.7% | not reported | ind. | 2022-01-27 | saturatedcontaminateddisputed |