Skip to content
Leaderboard

Mistral-Small-24B-Instruct-2501

Mistral AIopen weightsinactiveThis model is no longer in battles and gets no new votes.

Licence
Apache-2.0
ID
mistralai/Mistral-Small-24B-Instruct-2501

Mistral-Small-24B-Instruct-2501 no longer takes part in new comparisons. Its rating of 825 (±120) was set by the 37 votes cast while it took part. The rating's 95% interval is 705–945: it shows how precisely the votes have pinned the rating down so far. It won 20.0% of its decided comparisons (6 wins, 24 losses, 7 ties). The median length of its answers is 110 words. It is developed by Mistral AI. Its weights are open (licence: Apache-2.0).

At a glance

Rating
825±120
95% interval 705–945
Answer length
110words
median, typically 32–292
Votes
37
20.0% of decided votes won

Model information

Note: The model is made available in the arena via the NVIDIA NIM API.

More about the model (opens in a new tab)

Statistics

Rating with 95% confidence interval

  1. deepseek-v3.2inactive
  2. GaMS-27B-Instructinactive
  3. gpt-oss-20binactive
  4. Mistral-Small-24B-Instruct-2501inactive
  5. bielik-11b-v2.3-instructinactive
  6. llama3-70b-instructinactive
  7. nemotron-3.5-lightning-30b-a3binactive

The models just above and below it on the leaderboard, on one axis. The upright mark is the rating, the line its 95% interval.

Vote outcomes

  • Wins6
  • Ties7
  • Losses24
Total queries
49

Answer length among models

Median words per answer for every model on the leaderboard, on one axis.

Shorter answers than 24 of 39 other models.

All models in numbers
ModelMedian words
gpt-oss-120b463
Ministral-3-14B-Instruct-2512348
deepseek-r1336
gemini-2.5-pro330
Qwen3-Next-80B-A3B-Instruct312
gemma-4-26b-a4b-it306
Qwen3.6-27B284
gpt-oss-20b284
gemini-3-pro-preview260
gemini-2.5-flash242
GaMS-9B-Instruct-Nemotron229
GaMS-27B-Instruct-Nemotron226
gemini-3.1-pro-preview224
Mistral-Large-3-675B-Instruct-2512224
deepseek-r1-0528216
GaMS3-12B-Instruct201
nemotron-3-ultra-550b-a55b199
GaMS2-27B-Instruct196
gemma-4-31b-it179
gemini-3.8-flash178
llama3-70b-instruct168
gpt-5-mini152
kimi-k2-instruct142
gemini-3.5-flash141
Mistral-Small-24B-Instruct-2501110
gemma-3-12b-it107
bielik-11b-v2.3-instruct104
gpt-5101
gemma-3-27b-it101
gemini-1.5-pro100
llama-4-scout-17b-16e-instruct91
llama-3.3-70b-instruct90
EuroLLM-9B-Instruct83
gemini-2.0-flash78
llama-4-maverick-17b-128e-instruct78
gpt-5.6-luna77
gpt-4o68
Zlatorog-12B-Instruct-Beta47
GaMS-9B-Instruct13
GaMS-27B-Instruct10