whatmodel.sh / tts / Tacotron 2 + HiFi-GAN (VCTK, VITS study)

Tacotron 2 + HiFi-GAN (VCTK, VITS study) is a closed-weights text-to-speech model from VITS study (public implementations), released June 2021.

Catalogue identity notes

Comparison-only. Exact VCTK multi-speaker system in VITS (ICML 2021) Table 3 row 'Tacotron 2 + HiFi-GAN': NVIDIA Tacotron 2 implementation with broadcast speaker embedding concatenated to the encoder output, trained on VCTK (43,470 training clips, 22 kHz) by the VITS authors (§3.1, §4.2), HiFi-GAN second stage without fine-tuning. Study-specific weights, not released; distinct from tacotron2-hifigan-ljspeech. Needed so vits2021-vctk-mos (today a run of one, vits-vctk) has 3 models; the fine-tuned-HiFi-GAN rows (3.19, 3.82) are left out as unnecessary.

19.4±5.6comparison only: no current run option verifiedfrom 1 benchmark result across 1 source* thinly tested, treat the rank as provisional

Score within the Vapi Humanness · Bradley–Terry rating, 2026-09-25 snapshot comparison set only.

$ how it compares

The text-to-speech models ranked either side of Tacotron 2 + HiFi-GAN (VCTK, VITS study), out of 148 with a score, then more from VITS study (public implementations).

#modelscorewhereRAMreleased
140SpeechT5 TTS Microsoft23±3local~0.7GB2023-02
141MetaVoice 1B v0.1 MetaVoice20±3local~9.7GB2024-02
142Tacotron 2 + HiFi-GAN (VCTK, VITS study) VITS study (public implementations)19±6comparison only2021-06
143YourTTS Coqui / Edresson Casanova et al.18±3local~0.4GB2021-12
144MMS TTS Turkish Meta18±4local~0.2GB2023-09
more from VITS study (public implementations)
135Glow-TTS + HiFi-GAN (VCTK, VITS study) VITS study (public implementations)28±6comparison only2021-06

see all text-to-speech models · find the ones that fit your machine

$ what it's good at

other tests1 not in a task · 88% of its score
testresultvs the others in its rundifficultycountswhy
VITS 2021 VCTK human MOS3.14 / 5 ✎█····█·····█ beats 0/2very easy · avg 4.73 / 5▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 88%at its level · small run

$ where to run it

No verified API or download recorded yet · add one

Weights and documentation: github.com/NVIDIA ↗

$ how the score was worked out · VITS: ICML 2021 original list… 88%

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

sourceresultsshare of the scorelicence
VITS: ICML 2021 original listening studies1▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 88%CC-BY-4.0
prior · pull toward the middle▇▇▇▇ 12%
weighted average= 19.4

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json