Mistral-Small-24B-Instruct-2501
Mistral AIopen weightsinactiveThis model is no longer in battles and gets no new votes.
- Licence
- Apache-2.0
- ID
mistralai/Mistral-Small-24B-Instruct-2501
Mistral-Small-24B-Instruct-2501 no longer takes part in new comparisons. Its rating of 825 (±120) was set by the 37 votes cast while it took part. The rating's 95% interval is 705–945: it shows how precisely the votes have pinned the rating down so far. It won 20.0% of its decided comparisons (6 wins, 24 losses, 7 ties). The median length of its answers is 110 words. It is developed by Mistral AI. Its weights are open (licence: Apache-2.0).
At a glance
- Rating
- 825±120
- 95% interval 705–945
- Answer length
- 110words
- median, typically 32–292
- Votes
- 37
- 20.0% of decided votes won
Model information
Note: The model is made available in the arena via the NVIDIA NIM API.
Statistics
Rating with 95% confidence interval
- deepseek-v3.2inactive
- GaMS-27B-Instructinactive
- gpt-oss-20binactive
- Mistral-Small-24B-Instruct-2501inactive
- bielik-11b-v2.3-instructinactive
- llama3-70b-instructinactive
- nemotron-3.5-lightning-30b-a3binactive
The models just above and below it on the leaderboard, on one axis. The upright mark is the rating, the line its 95% interval.
Vote outcomes
- Wins6
- Ties7
- Losses24
- Total queries
- 49
Answer length among models
Median words per answer for every model on the leaderboard, on one axis.
Shorter answers than 24 of 39 other models.
All models in numbers
| Model | Median words |
|---|---|
| gpt-oss-120b | 463 |
| Ministral-3-14B-Instruct-2512 | 348 |
| deepseek-r1 | 336 |
| gemini-2.5-pro | 330 |
| Qwen3-Next-80B-A3B-Instruct | 312 |
| gemma-4-26b-a4b-it | 306 |
| Qwen3.6-27B | 284 |
| gpt-oss-20b | 284 |
| gemini-3-pro-preview | 260 |
| gemini-2.5-flash | 242 |
| GaMS-9B-Instruct-Nemotron | 229 |
| GaMS-27B-Instruct-Nemotron | 226 |
| gemini-3.1-pro-preview | 224 |
| Mistral-Large-3-675B-Instruct-2512 | 224 |
| deepseek-r1-0528 | 216 |
| GaMS3-12B-Instruct | 201 |
| nemotron-3-ultra-550b-a55b | 199 |
| GaMS2-27B-Instruct | 196 |
| gemma-4-31b-it | 179 |
| gemini-3.8-flash | 178 |
| llama3-70b-instruct | 168 |
| gpt-5-mini | 152 |
| kimi-k2-instruct | 142 |
| gemini-3.5-flash | 141 |
| Mistral-Small-24B-Instruct-2501 | 110 |
| gemma-3-12b-it | 107 |
| bielik-11b-v2.3-instruct | 104 |
| gpt-5 | 101 |
| gemma-3-27b-it | 101 |
| gemini-1.5-pro | 100 |
| llama-4-scout-17b-16e-instruct | 91 |
| llama-3.3-70b-instruct | 90 |
| EuroLLM-9B-Instruct | 83 |
| gemini-2.0-flash | 78 |
| llama-4-maverick-17b-128e-instruct | 78 |
| gpt-5.6-luna | 77 |
| gpt-4o | 68 |
| Zlatorog-12B-Instruct-Beta | 47 |
| GaMS-9B-Instruct | 13 |
| GaMS-27B-Instruct | 10 |