Streaming Hebrew text-to-speech. A Hebrew (and mixed Hebrew/English) finetune of
herimor/voxtream2, packaged as a clean,
installable Python inference library.
This repository hosts the model weights. The code that loads them lives in the GitHub
repo above; weights are fetched automatically the first time you construct SpeechGenerator().
Because the model is small and fully streaming, outputs are not always stable. Commercial
use is allowed but not recommended.
What it does
Voxtream2 is a zero-shot, full-stream text-to-speech model: you give it a few seconds of
any voice plus some text, and it speaks that text in that voice — no per-voice training needed.
Built for streaming. It produces audio in small chunks (one ~80 ms frame at a time)
while it reads the text. The first chunk comes back in tens of milliseconds, so it suits
live, interactive, real-time use (voice agents, dubbing, assistants).
Faster than real-time. On a consumer GPU it generates audio several times faster than
it takes to play.
Voice cloning from a short sample. Point it at a 3–10 second clip of a target voice and
it mimics that speaker — accent, tone, and timbre — without any fine-tuning.
Adjustable speaking rate. You can ask for faster or slower speech, even mid-sentence.
This is the Hebrew finetune. It speaks Hebrew (with English mixed in) and keeps all of the
streaming behavior above. The generator consumes phonemes (a Hebrew G2P front-end with
espeak-ng as the English fallback) and emits 24 kHz mono audio frames.
Usage
Install the library (see the GitHub repo for full
instructions, including the espeak-ng system dependency):
The Mimi codec (kyutai/moshiko-pytorch-bf16), the ReDimNet speaker encoder
(IDRnD/ReDimNet, via torch.hub), and the optional Sidon prompt enhancer
(sarulab-speech/sidon-v0.1) are pulled from their own upstream repos, not from here.
Acknowledgements
Voxtream2 — the upstream full-stream TTS model. herimor/voxtream
ReNikud — audio-supervised Hebrew grapheme-to-phoneme (G2P) model used as the Hebrew front-end. renikud/renikud
