s2-pro-BnB-4Bits is a low-bit checkpoint prepared for memory-efficient inference, published by groxaxo.
It is intended for open-source evaluation, reproducible experimentation, and compatible local or
hosted inference workflows. The wording below is deliberately limited to what can be verified
from this repository's metadata and artifacts.
Use a current Transformers release with BitsAndBytes support, keeping the tokenizer and model
configuration files from this repository alongside the checkpoint.
Compatibility and responsible use
Use a runtime that explicitly supports this format, architecture, and modality.
Keep configuration, tokenizer, processor, projection, and weight files from the same revision together.
Review the source model card and license before redistribution or deployment.
Hardware needs depend on parameter count, context length, cache precision, quantization, and concurrency.
Report reproducible issues with the runtime version, hardware, launch command, and a minimal example.
Quantization or conversion changes numerical behavior, memory use, and throughput relative to the source checkpoint; validate quality on your own workload.
Generated outputs may be inaccurate or unsuitable for a given use case. Users are responsible for
testing behavior, applying appropriate safeguards, and complying with applicable licenses and laws.
This repository hosts the Groxaxo NF4 release of Fish Audio S2-Pro for lower-VRAM inference.
Base model: Fish Audio S2-Pro
Relation: Quantized release
Format: bitsandbytes NF4 prequantized model.pth
Target hardware: practical single-GPU inference on 12 GB+ VRAM setups
Best paired with:groxaxo/fish-speech-int4-patch
This is a community-hosted release of the original Fish Audio model. Credit for the base model, research, and architecture belongs to the Fish Audio team.
Huge thanks to the original creators at Fish Audio and the upstream fishaudio/fish-speech project for building and open-sourcing S2-Pro.
If this NF4 release helps you, please star the companion GitHub project here:
Upstream S2-Pro is excellent, but many single-card workstations do not have enough VRAM for a comfortable default setup. This NF4 release makes S2-Pro much easier to run on common cards like the RTX 3060 while preserving the flagship model path.
Model notes
S2-Pro uses a Dual-Autoregressive architecture with a 4B slow AR stack and a fast residual AR stack.
It supports fine-grained inline control with natural-language tags such as [whisper], [laugh], and [sad].
It supports multilingual generation, multi-speaker prompting, and strong voice cloning workflows.
Prompt examples
text
1[whisper] We need to leave quietly before sunrise.
2[excited] We actually got it working on a 12 GB card.
3[sad] I waited for you at the station all night.
This model remains under the Fish Audio Research License. Research and non-commercial use is permitted under that license. Commercial use requires a separate agreement with Fish Audio.
