whatmodel.sh / Gemini 2.5 Flash-Lite

Gemini 2.5 Flash-Lite is a closed-weights language model from Google, released July 2025.

Catalogue identity notes

Release month: Gemini API changelog, July 22, 2025: 'Released gemini-2.5-flash-lite, our fast, low-cost, high-performance Gemini 2.5 model.'

Model information sources

Release date ↗

57.1±1.8#234 of 719 LLMsfrom 8 benchmark results across 7 sources

$ how it compares

The LLMs ranked either side of Gemini 2.5 Flash-Lite, out of 828 with a score, then more from Google.

#modelscorewhereRAMreleased
277Command A (03-2025) Cohere57±1api $4.38/M +local~37GB2025-03
278GPT-4o (2024-11-20) OpenAI57±1api $4.38/M2024-11
279Gemini 2.5 Flash-Lite Google57±2api $0.17/M2025-07
280Qwen2.5-Max (2025-01-25) Alibaba57±1comparison only2025-01
281Qwen2.5-Omni 7B Alibaba57±2local~6.4GB2025-03
more from Google
9Gemini 4 Argon (limited preview) Google82±1limited preview2026-09
23Gemini 3.8 Flash Google77±1api $1.50/M2026-09
32Gemini 3.7 Flash Google76±1api $1.50/M2026-08

see all LLMs · find the ones that fit your machine

$ what it's good at

agent tasks▁▁▃▆█▆▅▅▅▄▃▁ #190 of 300 * · 20% of its score · 2 tests

Beats o1 (2024-12-17), o3-mini, DeepSeek R1 0528 here, though they rank higher overall. Trails SmolLM3 3B, Jamba 1.5 Mini, Mellum2 12B-A2.5B Instruct here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
BFCL V4 (December 2025 archive)36.9% ✎▁▁▁▂██▅▅▆▂▂▂ beats 40/77hard · avg 32%▇▇▇▇▇▇ 14%at its level
Galileo Agent Leaderboard v2 (action completion)47.0% ✎▅▃·▃▃▅▅█▃█▅▅ beats 12/19hard · avg 27%▇▇ 5.8%at its level
math▁▂▃▅▆▅▄█▄▁▁▁ #226 of 398 * · 12% of its score · 1 test

Beats GPT-4o (2024-08-06), Command A (03-2025), GPT-4o (2024-11-20) here, though they rank higher overall. Trails Olmo 3 7B Instruct, DeepSeek R1 Distill Llama 8B, Phi-4-mini-reasoning 3.8B here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
MATH-Vision52.1% ✎▁▁·▁··▄▁▃▇▇█ beats 4/24medium · avg 47%▇▇▇▇▇ 12%at its level
vision & documents▁▁▃▂▁▃▄▂▆▇█▄ #99 of 147 * · 64% of its score · 2 tests

Beats DeepSeek V4 Flash Vision (Exp), GPT-4o (2024-08-06) here, though they rank higher overall. Trails Llama 4 Maverick (402B-A17B), GPT-4o (2024-05-13) here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
CharXiv (reasoning questions) lab55.5% ✎▃·▃·▃▃▃·▃▃█▅ beats 0/11medium · avg 40%▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 53%at its level
MATH-Vision52.1% ✎▁▁·▁··▄▁▃▇▇█ beats 4/24medium · avg 47%▇▇▇▇▇ 12%at its level
other tests4 not in a task · 14% of its score
testresultvs the others in its rundifficultycountswhy
Icelandic LLM Leaderboard average (Miðeind, Sept 2026 suite)26.2% ✎▁▁▃▂▂▄▁▃▄▄▄█ beats 10/38very hard · avg 14%▇▇▇ 7.3%typical
Open PT-LLM Leaderboard average (9 Portuguese tasks)82.3% ✎▃▁▁▁▁▁▁▁▂█▅▃ beats 269/276medium · avg 73%▇▇ 5.3%at its level · noisy
Vectara hallucination leaderboard, 2025 dataset (HHEM-2.3, factual consistency rate)97.1% ✎▁▁▂▃▄▄█▆▃▂▂▁ beats 107/140very easy · avg 94%▇ 1.3%blunt · maxed out · noisy
Vectara hallucination leaderboard (HHEM-2.3, factual consistency rate)96.7% ✎▁▂▁▂▅█▂▃▄▃▁▃ beats 97/98very easy · avg 90%▇ 0.0%blunt

$ where to run it

Through an API

api · $0.18/M · $0.1 in / $0.4 out per 1M tokens · 1M context · ai.google.dev ↗ · price sourceStandard base token rate from models.dev. Provider-specific tiers, long-context surcharges, caching and promotions may differ.

$ how the score was worked out · Google DeepMind Gemini model… 53%, Berkeley Function Calling Lea… 14%, Qwen/Qwen3.5-4B model card 12% and 4 more

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

sourceresultsshare of the scorelicence
Google DeepMind Gemini model page and model cards (lab-reported scores) · lab-reported1▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 53%Factual vendor-reported score (not licensed content)
Berkeley Function Calling Leaderboard result archive1▇▇▇▇ 14%Apache-2.0
Qwen/Qwen3.5-4B model card1▇▇▇ 12%apache-2.0
Miðeind Icelandic LLM Leaderboard1▇▇ 7%CC BY 4.0
Galileo Agent Leaderboard (v1 and v2 results)1▇▇ 6%Apache-2.0
Open Portuguese LLM Leaderboard (archived)1▇▇ 5%Apache-2.0
Vectara hallucination leaderboard (vectara/hallucination-leaderboard repository)2▇ 1%Apache-2.0
prior · pull toward the middle▇ 1%
weighted average= 57.1

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json