Skip to content
Leaderboard

GaMS3-12B-Instruct

CJVTopen weights

Licence
Gemma Terms of Use
ID
cjvt/GaMS3-12B-Instruct

GaMS3-12B-Instruct has a rating of 1,077 (±63) in the Slovenian Chat Arena, set by 368 votes in blind comparisons in Slovenian. The rating's 95% interval is 1,014–1,140: it shows how precisely the votes have pinned the rating down so far. It wins 62.5% of its decided comparisons (162 wins, 97 losses, 109 ties). The median length of its answers is 200 words. It is developed by CJVT. Its weights are open (licence: Gemma Terms of Use).

At a glance

Rating
1,077±63
95% interval 1,014–1,140
Answer length
200words
median, typically 33–521
Votes
368
62.5% of decided votes won

Model information

GaMS (Generative Model for Slovene) by the Centre for Language Resources and Technologies of the University of Ljubljana (CJVT). Instruction model built on Google Gemma 3 12B.

More about the model (opens in a new tab)

Statistics

Rating with 95% confidence interval

  1. gemini-2.5-proinactive
  2. gemini-2.5-flashinactive
  3. GaMS-27B-Instruct-Nemotroninactive
  4. GaMS3-12B-Instruct
  5. gpt-5
  6. gemini-2.0-flashinactive
  7. GaMS-9B-Instruct-Nemotron

The models just above and below it on the leaderboard, on one axis. The upright mark is the rating, the line its 95% interval.

Vote outcomes

  • Wins162
  • Ties109
  • Losses97
Total queries
562

Answer length among models

Median words per answer for every model on the leaderboard, on one axis.

Longer answers than 18 of 30 other models.

All models in numbers
ModelMedian words
gpt-oss-120b463
Ministral-3-14B-Instruct-2512348
deepseek-r1336
gemini-2.5-pro330
Qwen3-Next-80B-A3B-Instruct312
gpt-oss-20b284
gemini-3-pro-preview260
gemini-2.5-flash242
GaMS-9B-Instruct-Nemotron236
GaMS-27B-Instruct-Nemotron226
Mistral-Large-3-675B-Instruct-2512224
deepseek-r1-0528216
GaMS3-12B-Instruct200
llama3-70b-instruct168
gpt-5-mini163
kimi-k2-instruct142
Mistral-Small-24B-Instruct-2501110
gpt-5107
gemma-3-12b-it107
bielik-11b-v2.3-instruct104
gemma-3-27b-it101
gemini-1.5-pro100
llama-4-scout-17b-16e-instruct91
llama-3.3-70b-instruct90
EuroLLM-9B-Instruct83
gemini-2.0-flash78
llama-4-maverick-17b-128e-instruct78
gpt-4o68
Zlatorog-12B-Instruct-Beta47
GaMS-9B-Instruct13
GaMS-27B-Instruct10