whatmodel.sh / Gemini 1.0 Pro (001)

Gemini 1.0 Pro (001) is a closed-weights language model from Google, released December 2023. Licence: proprietary.

Catalogue identity notes

Comparison model from the Epoch AI internal-evaluation CSVs (Epoch release date 2023-12-13). API model gemini-1.0-pro-001. Not listed on the current Gemini API models or deprecations pages (observed 2026-09-28).

45.7±1.6comparison only: no current run option verifiedfrom 6 benchmark results across 4 sources

$ how it compares

The LLMs ranked either side of Gemini 1.0 Pro (001), out of 828 with a score, then more from Google.

#modelscorewhereRAMreleased
510Granite 34B Code Instruct (8K) IBM46±1local~22GB2024-04
511WizardCoder Python 34B V1.0 WizardLM46±1local~23GB2023-08
512Gemini 1.0 Pro (001) Google46±2comparison only2023-12
513Mistral Medium (2312) Mistral46±1comparison only2023-12
514GPT-3.5 Turbo (0613) OpenAI46±1comparison only2023-06
more from Google
9Gemini 4 Argon (limited preview) Google82±1limited preview2026-09
23Gemini 3.8 Flash Google77±1api $1.50/M2026-09
32Gemini 3.7 Flash Google76±1api $1.50/M2026-08

see all LLMs · find the ones that fit your machine

$ what it's good at

chat & writing▁▁▁▃▅▄▆█▇▇▇▃ #336 of 463 * · 43% of its score · 2 tests

Beats Ministral 3 14B Reasoning 2512, Gemma 4 E4B, Ministral 3 8B here, though they rank higher overall. Trails Flan-T5 XXL, LFM2 700M, EXAONE 3.5 2.4B Instruct here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
Polyrating rating (bias-aware re-fit of Chatbot Arena votes, mid-2024)1182.0 ✎▂▁▂▁▃▇█▆▇▄▂▂ beats 77/95avg 1201▇▇▇▇▇▇▇▇▇ 22%blunt
LMArena (text)1236.8 ✎▁▁▁▂▃▃▃▆▆▇█▃ beats 87/379avg 1268▇▇▇▇▇▇▇▇▇ 21%blunt
math▁▂▃▅▇▅▅█▄▁▁▁ #407 of 462 * · 34% of its score · 2 tests

Trails Qwen3 0.6B, Tulu 2 DPO 7B, Gemma 7B (base) here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
MATH level 511.2% ✎▂▂▅▆▄█▆▃▅▂▃▄ beats 7/92hard · avg 32%▇▇▇▇▇▇▇▇▇▇▇▇ 31%sharp
OTIS mock AIME 2024–20251.1% ✎▃▃▄▃▃▃▇▇█▃▂▅ beats 9/193very hard · avg 8.5%▇ 3.1%sharp · too hard for it · noisy
other tests2 not in a task · 22% of its score
testresultvs the others in its rundifficultycountswhy
GPQA Diamond34.0% ✎▁▁▁▁▃▄▆▄▅▇█▅ beats 26/208hard · avg 40%▇▇▇▇▇▇▇ 17%sharp
Open PT-LLM Leaderboard average (9 Portuguese tasks)69.9% ✎▃▁▁▁▁▁▁▁▂█▅▁ beats 163/276medium · avg 73%▇▇ 4.8%at its level · noisy

$ where to run it

No verified API or download recorded yet · add one

$ how the score was worked out · Epoch AI — internal evaluatio… 51%, Polyrating: A Cost-Effective… 22%, LMArena leaderboard dataset 21% and 1 more

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

sourceresultsshare of the scorelicence
Epoch AI — internal evaluations3▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 51%CC BY 4.0
Polyrating: A Cost-Effective and Bias-Aware Rating System for LLM Evaluation (arXiv:2409.00696v3)1▇▇▇▇▇▇▇ 22%CC-BY-4.0
LMArena leaderboard dataset1▇▇▇▇▇▇ 21%CC BY 4.0
Open Portuguese LLM Leaderboard (archived)1▇ 5%Apache-2.0
prior · pull toward the middle▇ 1%
weighted average= 45.7

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json