MBPP+
Extended MBPP tests
codingsaturated
Definition
- Version
- not in the notes
- Category
- coding
- Maintainer
- EvalPlus
- Status
- saturated
- Home page
- not in the notes
Sources
- huggingface.co/JetBrains/Mellum2.1-12B-A2.5B-Thinking https://huggingface.co/JetBrains/Mellum2.1-12B-A2.5B-Thinking
Scores
| Model | Score | Who ran it | Setting | View or population | Date | Source |
|---|---|---|---|---|---|---|
 Mellum2.1-12B-A2.5B-Thinking | 79.4 | vendor-reported | thinking mode | – | – | huggingface.co |
Where this comes from
Scores from different settings, harnesses or dates are not directly comparable; the row says which. Sorted by score, highest first, as a reading aid, not a ranking.
To cite this page: Project AURION, AI Use-Cases Research & Innovation, "MBPP+", https://aurion.semai.id/benchmarks/mbpp-plus/, records of October 2026.