Claude Instant 1.2
anthropic/claude-instant-1.2
Creator
AnthropicReleased
2023-08-09Weights
not reportedContext
not reportedPrice in / out per Mtok
not reported / not reportedState
rankedHealth summary
0 of 3 scores sit on benchmarks that still discriminate. 1 is vendor-reported with no independent measurement to check it against. 3 sit on benchmarks with a high risk of test-set contamination.
Scores
| Benchmark | Config | Score | Harness | Provenance | Measured | Health |
|---|---|---|---|---|---|---|
| On benchmarks that no longer discriminateKept visible on purpose. These are often the numbers a launch announcement leads with. | ||||||
| GSM8Ksaturated | base | 86.7% | not reported | vendor | 2023-08-09 | saturatedcontaminatedvendor only |
| MMLUsaturated | base | 68.8% | not reported | ind. | 2023-08-09 | saturatedcontaminatedsuperseded |
| MMLUsaturated | base | 73.2% | not reported | vendor | 2023-08-09 | saturatedcontaminatedsuperseded |