Causal fine-tune of
charactr/vocos-mel-24khz for real-time streaming inference.
Mel frames go in chunk by chunk, audio comes out with ~85 ms algorithmic latency (4-frame lookahead + ISTFT overlap-add),
numerically identical to the offline forward pass.
Code, streaming inference (
VocosStreamer), and training setup:
https://github.com/thewh1teagle/vocosTrained with the standard Vocos GAN objective (multi-period + multi-resolution discriminators, mel + adversarial + feature-matching losses),
batch 16, 16384-sample crops. This checkpoint is a full PyTorch Lightning checkpoint (~epoch 14, step ~277k) including generator,
discriminators, and optimizer states — usable both for inference (filter the feature_extractor./backbone./head. keys) and to
resume training.
See
examples/streaming_infer_ckpt.py
for loading this checkpoint and streaming audio chunk by chunk.
