You can deploy this model and start earning money today!

soda-research/
discrete-audio-isoflop-1.8e19-1.44B-d1792-L18-B8-2c1fe4

Name: discrete-audio-isoflop-1.8e19-1.44B-d1792-L18-B8-2c1fe4
Availability: InStock

next-token-prediction

isoflop

research

apache-2.0

Views

No views yet

Discrete Audio IsoFLOP Model (discrete-audio-isoflop-1.8e19-1.44B-d1792-L18-B8-2c1fe4)

A suite of discrete audio models trained for our IsoFLOP study as part of SODA, which is a unified next-token prediction on interleaved semantic, acoustic, and text tokens.

🥤 Project Page: https://soda-audio.github.io

For full usage instructions (e.g., inference code), and more information, please refer to the SODA-4B-base model card.

The details for this particular model is as follows:

compute_budget: 1.8e19
param_count (non-embedding): 1.44B
hidden_dim: 1792
num_layers: 18
batch_size: 8
training_step: 63146
hash_key: 2c1fe4

📈 WandB: https://wandb.ai/potsawee/marin/groups/IsoFlop/workspace

soda-research/discrete-audio-isoflop-1.8e19-1.44B-d1792-L18-B8-2c1fe4

Discrete Audio IsoFLOP Model (discrete-audio-isoflop-1.8e19-1.44B-d1792-L18-B8-2c1fe4)

soda-research/
discrete-audio-isoflop-1.8e19-1.44B-d1792-L18-B8-2c1fe4