Project AURIONAI Use-Cases Research & Innovation

Arena-Hard

Hard chat prompts judged against a baseline

human preference arena
1scores
1models
0independent
0maintainer-run
1vendor-reported

Definition

Version
not in the notes
Category
human preference arena
Maintainer
not in the notes
Status
not in the notes
Home page
not in the notes

Sources

  1. huggingface.co/ai21labs/AI21-Jamba-Mini-1.5 https://huggingface.co/ai21labs/AI21-Jamba-Mini-1.5
  2. ai21.com/blog/announcing-jamba-model-family https://www.ai21.com/blog/announcing-jamba-model-family

Scores

1 of 1 scores shown arena-hard-scores.csv
ModelScoreWho ran itSettingView or populationDateSource
AI21 LabsJamba 1.5 Mini46.1 scorevendor-reported––22 Aug 2024ai21.com
Where this comes from
Scores from different settings, harnesses or dates are not directly comparable; the row says which. Sorted by score, highest first, as a reading aid, not a ranking.

To cite this page: Project AURION, AI Use-Cases Research & Innovation, "Arena-Hard", https://aurion.semai.id/benchmarks/arena-hard/, records of October 2026.