whatmodel.sh / tts / Tacotron2 + HiFi-GAN (Grad-TTS study)

Tacotron2 + HiFi-GAN (Grad-TTS study)

+ contribute
Update model informationAdd a place to run itAdd a test resultPropose a benchmarkCorrect a benchmark scoreEdit data on GitHub

Tacotron2 + HiFi-GAN (Grad-TTS study) is a closed-weights text-to-speech model from Grad-TTS authors / Huawei Noah, released May 2021.

Catalogue identity notes

Tacotron2 acoustic model paired with HiFi-GAN by the Grad-TTS authors in ICML 2021 section 4 / Table 2. Study-specific evaluated system; exact trained weights are not verified as released, so no open-weight or run-availability claim. Distinct from Coqui Glow-TTS and NVIDIA Tacotron2 + WaveGlow.

Model information sources

Release date ↗

60.9±22.8comparison only: no current run option verifiedfrom 1 benchmark result across 1 source* thinly tested, treat the rank as provisional

Score within the Grad-TTS 2021 LJ Speech human MOS comparison set only.

$ how it compares

Scored text-to-speech models released closest to Tacotron2 + HiFi-GAN (Grad-TTS study), out of 148 with a score.

#modelscorewhereRAMreleased
81Azure Ameha Neural Microsoft50±16comparison only2021-10
82Azure Mekdes Neural Microsoft50±16comparison only2021-10
124VITS (VCTK multi-speaker) Kakao Enterprise (Jaehyeon Kim et al.)34±5local~0.2GB2021-06
135Glow-TTS + HiFi-GAN (VCTK, VITS study) VITS study (public implementations)28±6comparison only2021-06
142Tacotron 2 + HiFi-GAN (VCTK, VITS study) VITS study (public implementations)19±6comparison only2021-06

see all text-to-speech models · find the ones that fit your machine

$ what it's good at

other tests1 not in a task · 58% of its score
testresultvs the others in its rundifficultycountswhy
Grad-TTS 2021 LJ Speech human MOS4.32 / 5 ✎█·····█···██ beats 2/3easy · avg 4.17 / 5▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 58%typical

$ where to run it

No verified API or download recorded yet · add one

$ how the score was worked out · Grad-TTS: original ICML 2021… 58%

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

sourceresultsshare of the scorelicence
Grad-TTS: original ICML 2021 listening study1▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 58%CC-BY-4.0
prior · pull toward the middle▇▇▇▇▇▇▇▇▇▇▇▇▇ 42%
weighted average= 60.9

$ improve this page

Update model informationAdd a place to run itAdd a test resultPropose a benchmarkCorrect a benchmark scoreEdit data on GitHub

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json