Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
tinyworlds-zelda-vtok-h512-b8-lr1e4 – AI Model by AlekOne1 | AlphaNeural AI
You can deploy this model and start earning money today!
AlekOne1
/
tinyworlds-zelda-vtok-h512-b8-lr1e4
like
0
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
TinyWorlds Zelda Video Tokenizer
Video tokenizer checkpoint for Tiny World Models dynamics training.
Model:
embed_dim: 256
num_heads: 8
hidden_dim: 512
num_blocks: 8
Q/K RMSNorm: enabled
Training:
start LR: 1e-5
peak LR: 1e-4
warmup: 3000 steps
cosine decay
batch_size_per_gpu: 4
grad_accum: depends on allocated GPUs in flex run
