Skip to content
Leaderboard

gemma-3-12b-it

Googleopen weightsinactiveThis model is no longer in battles and gets no new votes.

Licence
Gemma Terms of Use
ID
google/gemma-3-12b-it

gemma-3-12b-it no longer takes part in new comparisons. Its rating of 966 (±71) was set by the 180 votes cast while it took part. The rating's 95% interval is 895–1,037: it shows how precisely the votes have pinned the rating down so far. It won 41.4% of its decided comparisons (53 wins, 75 losses, 52 ties). The median length of its answers is 107 words. It is developed by Google. Its weights are open (licence: Gemma Terms of Use).

At a glance

Rating
966±71
95% interval 895–1,037
Answer length
107words
median, typically 12–483
Votes
180
41.4% of decided votes won

Model information

Note: The model is made available in the arena via the Google Gemini Developer API.

More about the model (opens in a new tab)

Statistics

Rating with 95% confidence interval

  1. deepseek-r1-0528inactive
  2. llama-4-maverick-17b-128e-instructinactive
  3. Zlatorog-12B-Instruct-Betainactive
  4. gemma-3-12b-itinactive
  5. llama-4-scout-17b-16e-instructinactive
  6. Qwen3-235B-A22Binactive
  7. EuroLLM-9B-Instructinactive

The models just above and below it on the leaderboard, on one axis. The upright mark is the rating, the line its 95% interval.

Vote outcomes

  • Wins53
  • Ties52
  • Losses75
Total queries
274

Answer length among models

Median words per answer for every model on the leaderboard, on one axis.

Shorter answers than 16 of 29 other models.

All models in numbers
ModelMedian words
gpt-oss-120b463
Ministral-3-14B-Instruct-2512348
deepseek-r1336
gemini-2.5-pro330
Qwen3-Next-80B-A3B-Instruct312
gpt-oss-20b285
gemini-3-pro-preview260
gemini-2.5-flash242
GaMS-9B-Instruct-Nemotron236
GaMS-27B-Instruct-Nemotron226
Mistral-Large-3-675B-Instruct-2512224
deepseek-r1-0528216
GaMS3-12B-Instruct200
gpt-5-mini162
kimi-k2-instruct142
Mistral-Small-24B-Instruct-2501110
gpt-5107
gemma-3-12b-it107
bielik-11b-v2.3-instruct104
gemma-3-27b-it101
gemini-1.5-pro100
llama-4-scout-17b-16e-instruct91
llama-3.3-70b-instruct90
EuroLLM-9B-Instruct83
gemini-2.0-flash78
llama-4-maverick-17b-128e-instruct78
gpt-4o68
Zlatorog-12B-Instruct-Beta47
GaMS-9B-Instruct13
GaMS-27B-Instruct10