whatmodel.sh / tts / FastSpeech 2 + HiFi-GAN (SpeechBrain LJ Speech)

FastSpeech 2 + HiFi-GAN (SpeechBrain LJ Speech) is an open-weights text-to-speech model from SpeechBrain, released November 2022. Licence: apache-2.0.

Catalogue identity notes

SpeechBrain-trained FastSpeech2 acoustic model plus its LJ Speech HiFi-GAN vocoder. Original-paper MOS is not transferred to this checkpoint. CPU run command adapted from model card; memory is an estimated 4GB runtime budget, not a local measurement.

Model information sources

Release date ↗

No comparable score yet. No reviewed benchmark results yet.

$ how it compares

Scored text-to-speech models released closest to FastSpeech 2 + HiFi-GAN (SpeechBrain LJ Speech), out of 148 with a score.

#modelscorewhereRAMreleased
85MMS TTS Amharic Meta50±16local~0.2GB2023-05
96Piper (en_US lessac medium) Open Home Foundation (Piper)47±5local~0.1GB2023-06
132Tortoise TTS v2 Tortoise29±2local~4.5GB2022-04
139Bark Suno25±3local~4.5GB2023-04
140SpeechT5 TTS Microsoft23±3local~0.7GB2023-02

see all text-to-speech models · find the ones that fit your machine

$ where to run it

Other ways to run it

  1. Run it as published · needs ~4 GB · from huggingface.co/speechbrain (official)
    uv run --with speechbrain --with soundfile python -c "import soundfile as sf; from speechbrain.inference.TTS import FastSpeech2; from speechbrain.inference.vocoders import HIFIGAN; t=FastSpeech2.from_hparams(source='speechbrain/tts-fastspeech2-ljspeech', savedir='pretrained/fastspeech2'); v=HIFIGAN.from_hparams(source='speechbrain/tts-hifigan-ljspeech', savedir='pretrained/hifigan'); mel,_,_,_=t.encode_text(['Hello world.']); wav=v.decode_batch(mel); sf.write('speech.wav', wav.squeeze().detach().cpu().numpy(), 22050)"

Official weights and documentation: huggingface.co/speechbrain ↗

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json