Beta
Explore
Marketplace
Neural Labs
Playground
Wallet
Docs
v2-babylm-nld-ell-sequential_interleaved – AI Model by nikitastheo | AlphaNeural AI | AlphaNeural AI
You can deploy this model and start earning money today!
nikitastheo
/
v2-babylm-nld-ell-sequential_interleaved
like
0
transformers
safetensors
gpt2
text-generation
causal-lm
text-generation-inference
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
nikitastheo/v2-babylm-nld-ell-sequential_interleaved
Trained with train_clm.py, a Hugging Face Accelerate causal-LM training script (no
Trainer
).
Training details
Base config
:
model_configs/gpt_base_config.json
Tokenizer
:
nikitastheo/babylm-nld-tokenizer
Max steps
: 24820
Learning rate
: 0.0001
LR scheduler
: linear
Warmup steps
: 2482
Batch size (per device)
: 32
Gradient accumulation steps
: 1
Total train batch size
: 32
Language switch epoch
: 10
