Project AURIONAI Use-Cases Research & Innovation

Multilingual MMLU

Multilingual version of MMLU (Phi-4-mini card)

knowledge and reasoning
2scores
2models
0independent
0maintainer-run
2vendor-reported

Definition

Version
not in the notes
Category
knowledge and reasoning
Maintainer
not in the notes
Status
not in the notes
Home page
not in the notes

Sources

  1. huggingface.co/microsoft/Phi-4-mini-instruct https://huggingface.co/microsoft/Phi-4-mini-instruct

Scores

2 of 2 scores shown multilingual-mmlu-scores.csv
ModelScoreWho ran itSettingView or populationDateSource
AnthropicClaude Opus 487.4 %vendor-reportedMMMLU, without extended thinkingAnthropic announcement22 May 2025anthropic.com
Microsoft AIPhi-4-mini-instruct49.3 %vendor-reported–––huggingface.co
Where this comes from
Scores from different settings, harnesses or dates are not directly comparable; the row says which. Sorted by score, highest first, as a reading aid, not a ranking.

To cite this page: Project AURION, AI Use-Cases Research & Innovation, "Multilingual MMLU", https://aurion.semai.id/benchmarks/multilingual-mmlu/, records of October 2026.