whatmodel.sh / Gemini 4 Carbon

Gemini 4 Carbon is a closed-weights language model from Google, released October 2026.

Limited preview · broad public access is not yet available. Access announcement ↗

Catalogue identity notes

Limited rollout to selected cyber defenders and trusted partners. No broadly available API or weights verified on 2026-10-29; announced future price is not a purchasable API route.

Model information sources

Release date ↗

83.3±1.4#4 of 731 LLMsfrom 3 benchmark results across 1 source

Score within the LMArena (text) comparison set only.

$ how it compares

The LLMs ranked either side of Gemini 4 Carbon, out of 884 with a score, then more from Google.

#modelscorewhereRAMreleased
2Claude Opus 5.5 Anthropic85±1api $8.00/M2026-09
3GPT-6.1 Terra OpenAI84±1api $2.00/M2026-10
4Gemini 4 Carbon Google83±1limited preview2026-10
5GPT-6.1 Sol OpenAI83±1api $4.00/M2026-09
6Claude Fable 5.1 Anthropic82±1api $20.00/M2026-09
more from Google
9Gemini 4 Argon Google81±1api $4.00/M2026-09
26Gemini 3.8 Flash Google76±1api $1.50/M2026-09
36Gemini 3.7 Flash Google75±1api $1.50/M2026-08

see all LLMs · find the ones that fit your machine

$ what it's good at

agent tasks▁▁▃▆█▄▅▅▄▄▂▃ #2 of 312 * · 46% of its score · 1 test

Beats GPT-6 Astra, GPT-6.1 Terra here, though they rank higher overall.

testresultvs the others in its rundifficultycountswhy
Arena Agent (October 2026 aggregate IPS)0.1604 IPS ✎▁▁▁▃▃▃█▁▁▂▃▁ beats 53/54avg -0.382 IPS▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 46%sharp
coding▁▁▁▃▅▇█▇▅▄▃▃ #3 of 468 * · 34% of its score · 1 test

Beats GPT-6.1 Terra here, though they rank higher overall.

testresultvs the others in its rundifficultycountswhy
Arena WebDev (Code Arena)1768.2 ✎▁▁▃▂▅█▃▆▅▅▁▃ beats 126/129avg 982▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 34%sharp
chat & writing▁▁▁▃▆▄▆█▆▇▇▃ #1 of 401 * · 19% of its score · 1 test

Beats GPT-6 Astra, Claude Opus 5.5 here, though they rank higher overall.

testresultvs the others in its rundifficultycountswhy
LMArena (text)1527.5 ✎▁▁▁▂▃▃▃▆▆▇█▃ beats 385/385avg 1259▇▇▇▇▇▇▇▇ 19%blunt
other tests2 not in a task · 0.0% of its score
testresultvs the others in its rundifficultycountswhy
SEC-Bench Pro (pass@1) lab88.2% ✎▄·▄·▄·█▄···▄ beats 6/6—not counted yet: no other model in the same run to compare it with
ExploitGym (pass@1) lab54.8% ✎▄·▄··█·▄▄··▄ beats 6/6—not counted yet: no other model in the same run to compare it with

$ where to run it

No verified API or download recorded yet · add one

$ how the score was worked out · LMArena leaderboard dataset 99%

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

sourceresultsshare of the scorelicence
LMArena leaderboard dataset3CC BY 4.0
prior · pull toward the middle
weighted average= 83.3

not counted (2)

Google DeepMind Gemini model page and model cards (lab-reported scores)SEC-Bench Pro (pass@1) [correct]88.2%fewer than three models have this test yet, or this source ran it for this model alone
Google DeepMind Gemini model page and model cards (lab-reported scores)ExploitGym (pass@1) [correct]54.8%fewer than three models have this test yet, or this source ran it for this model alone

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json