whatmodel.sh / stt / Chirp 2

Chirp 2 is a closed-weights speech-to-text model from Google. Licence: proprietary.

Catalogue identity notes

Google Cloud Speech-to-Text v2 model 'chirp_2' (leaderboard entry google/chirp_2). Distinct from catalogue google-chirp-3 and from the original 'chirp'. Google updated the GA chirp_2 model on 2024-10-07; the leaderboard does not state which date it was run, so no release month is given.

58.0±2.9#46 of 162 speech-to-text modelsfrom 5 benchmark results across 3 sources

Score within the Open ASR English short-form WER (March 2026) comparison set only.

$ how it compares

The speech-to-text models ranked either side of Chirp 2, out of 176 with a score, then more from Google.

#modelscorewhereRAMreleased
53Universal-Streaming (English) AssemblyAI58±3api $0.0025/audio min2025-06
54Parakeet RNNT 1.1B NVIDIA58±2local~5.6GB2024-01
55Chirp 2 Google58±3api price unknown
56Canary-1B-v2 NVIDIA58±1local~5.2GB2025-08
57Phi-4-multimodal-instruct Microsoft58±2local~14GB2025-02
more from Google
11Gemini 3.5 Transcribe Google67±6api $0.0050/audio min2026-08
31Chirp 3 Google61±2api price unknown2025-03
33Gemini 3.5 Transcribe Live Google61±3api $0.0090/audio min2026-08

see all speech-to-text models · find the ones that fit your machine

$ what it's good at

other tests5 not in a task · 97% of its score
testresultvs the others in its rundifficultycountswhy
Bangla STT benchmark · BanSpeech 1,001-clip batch CER21.9% ✎█·▄··▄··▄·▄▄ beats 2/6avg 37%▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 37%sharp
Open ASR English short-form WER (March 2026)6.4% ✎▁▁▁▃··▁▁▂██▆ beats 71/86avg 8.2%▇▇▇▇▇▇▇▇▇▇▇ 29%blunt
verli STT benchmark · LibriSpeech test-clean WER2.3% ✎▃·····▃▅█▃▅▅ beats 2/11avg 3.4%▇▇▇▇▇▇▇ 17%typical
verli STT benchmark · SPGISpeech 1,200-clip sample WER2.3% ✎▂·····▄▂█▂▃▄ beats 9/11avg 4.6%▇▇▇ 7.9%typical
verli STT benchmark · Earnings-22 WER (2,741 utt.)12.7% ✎▃·▃▅··▃▃▅▅█▃ beats 4/13avg 16%▇▇▇ 7.2%blunt

$ where to run it

Through an API

api · Google Cloud · price unknown · cloud.google.com ↗

$ how the score was worked out · Bangla Speech-to-Text Benchma… 37%, verliapp/stt-benchmark · inde… 32%, Open ASR Leaderboard 29%

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

sourceresultsshare of the scorelicence
Bangla Speech-to-Text Benchmark v1.0 (Riverborn)1▇▇▇▇▇▇▇▇▇▇▇ 37%MIT
verliapp/stt-benchmark · independent STT accuracy benchmark3▇▇▇▇▇▇▇▇▇▇ 32%MIT
Open ASR Leaderboard1▇▇▇▇▇▇▇▇▇ 29%Apache-2.0
prior · pull toward the middle▇ 3%
weighted average= 58.0

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json