LayaCodec: Rapid, High-Fidelity Audio Compression: Reaching the Pareto Frontier in Neural Audio Codecs
This is a neural audio codec/tokenizer that encodes 16khz at a rate from 12.5 t/s(0.16 kpbs) to 50 t/s(0.65 kpbs) using a single 8192 size codebook and decodes it into 44.1khz audio.
This allows for much faster and scalable TTS models compared to othern modern codecs for several reasons.
Much lower token rates than other single pass codecs such as Xcodec2(50 t/s), Snac(83 t/s), Dac(774 t/s), etc.
Much smaller codebook size(8192) compared to Xcodec2(65536) for faster TTS model training speed.
Over 40x faster then most diffusion based codecs allowing for much simpler and larger scale TTS models where codecs are not the bottleneck.
Decodes audio into 44.1khz which is much higher quality then the common 24khz or 16khz sampling rate.
