COPY OF hubertsiuzdak/snac_44khz

Multi-Scale Neural Audio Codec (SNAC) compressess audio into discrete codes at a low bitrate.

👉 This model was primarily trained on music data, and its recommended use case is music (and SFX) generation. See below for other pretrained models.

🔗 GitHub repository: https://github.com/hubertsiuzdak/snac/

SNAC encodes audio into hierarchical tokens similarly to SoundStream, EnCodec, and DAC. However, SNAC introduces a simple change where coarse tokens are sampled less frequently, covering a broader time span.

This model compresses 44 kHz audio into discrete codes at a 2.6 kbps bitrate. It uses 4 RVQ levels with token rates of 14, 29, 57, and 115 Hz.

Currently, all models support only single audio channel (mono).

Install it using:

To encode (and decode) audio with SNAC in Python, use the following code:

You can also encode and reconstruct in a single call:

⚠️ Note that codes is a list of token sequences of variable lengths, each corresponding to a different temporal resolution.

>>> [code.shape[1] for code in codes]
[16, 32, 64, 128]

Module definitions are adapted from the Descript Audio Codec.