Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

v2-babylm-zho-ell-sequential_interleaved – AI Model by nikitastheo | AlphaNeural AI

You can deploy this model and start earning money today!

nikitastheo/
v2-babylm-zho-ell-sequential_interleaved

like

0

text-generation

text-generation-inference

endpoints_compatible

Views

No views yet

nikitastheo/v2-babylm-zho-ell-sequential_interleaved

Trained with train_clm.py, a Hugging Face Accelerate causal-LM training script (no Trainer).

Training details

Base config: model_configs/gpt_base_config.json
Tokenizer: nikitastheo/babylm-zho-tokenizer
Max steps: 22970
Learning rate: 0.0001
LR scheduler: linear
Warmup steps: 2297
Batch size (per device): 32
Gradient accumulation steps: 1
Total train batch size: 32
Language switch epoch: 10