soape_130m_16 – AI Model by OptimizerStudy | AlphaNeural AI

You can deploy this model and start earning money today!

OptimizerStudy/
soape_130m_16

like

0

Views

No views yet

Model Card

Source: https://arxiv.org/abs/2509.02046
Optimizer: soape
Model size: 130m
Data size: 42B

Best configuration

Hyperparameter	Value
beta1	`0.95`
beta2	`0.99`
block_size	`512`
epsilon	`1e-10`
learning_rate	`0.008`
max_grad_norm	`1`
min_lr_ratio	`0`
partition_grads_into_blocks	`True`
precondition_frequency	`10`
shampoo_beta	`0.98`
train_batch_size	`256`
warmup	`1000`
weight_decay	`0.1`