whatmodel.sh / Gemini Experimental 1206

Gemini Experimental 1206 is a closed-weights language model from Google, released December 2024. Licence: proprietary.

Catalogue identity notes

Comparison-only: retired or no longer listed API model, kept so its independent runs can be scored. Dated experimental Gemini API model id gemini-exp-1206 (December 6, 2024), called directly by the Aider runs below (command 'aider --model gemini/gemini-exp-1206'); experimental, no longer served. Not in the Gemini API changelog page; identity rests on the exact dated API id.

60.5±1.6comparison only: no current run option verifiedfrom 2 benchmark results across 2 sources* thinly tested, treat the rank as provisional

$ how it compares

The LLMs ranked either side of Gemini Experimental 1206, out of 1132 with a score, then more from Google.

#modelscorewhereRAMreleased
276Qwen3.5 4B Alibaba61±1local~4.3GB2026-03
277Nemotron-Cascade-14B-Thinking NVIDIA61±1local~10GB2025-12
278Gemini Experimental 1206 Google61±2comparison only2024-12
279Mellum2.1 12B-A2.5B Thinking JetBrains60±2local~8.3GB2026-09
280GPT-4.1 mini OpenAI60±1api $0.70/M2025-04
more from Google
9Gemini 4 Argon (limited preview) Google82±1limited preview2026-09
23Gemini 3.8 Flash Google77±1api $1.50/M2026-09
32Gemini 3.7 Flash Google76±1api $1.50/M2026-08

see all LLMs · find the ones that fit your machine

$ what it's good at

coding▁▁▁▃▅▇█▇▅▄▂▁ #190 of 549 * · 99% of its score · 2 tests

Beats Gemini 2.5 Pro, Qwen3-Coder-Next (80B-A3B), Grok 4.1 Fast (Reasoning) here, though they rank higher overall. Trails QwQ-32B-Preview, Ministral 3 8B Reasoning 2512, Phi-4-reasoning 14B here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
Aider polyglot (225 exercises, two attempts)38.2% ✎▂·▂▃▅▂▃█▆▄▂▂ beats 19/49very hard · avg 8.5%▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 67%sharp · at its level
Aider code editing (133 Exercism Python exercises, two attempts)80.5% ✎▁·▁▂▄▁▆▄█▆▂▃ beats 60/62medium · avg 54%▇▇▇▇▇▇▇▇▇▇▇▇▇ 31%typical

$ where to run it

No verified API or download recorded yet · add one

$ how the score was worked out · Aider polyglot benchmark runs 67%, Aider code editing benchmark… 31%

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

sourceresultsshare of the scorelicence
Aider polyglot benchmark runs1▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 67%Apache-2.0
Aider code editing benchmark runs (old edit leaderboard)1▇▇▇▇▇▇▇▇▇ 31%Apache-2.0
prior · pull toward the middle▇ 1%
weighted average= 60.5

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json