Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
mixed-ell-ell-sequential_interleaved – AI Model by nikitastheo | AlphaNeural AI
You can deploy this model and start earning money today!
nikitastheo
/
mixed-ell-ell-sequential_interleaved
like
0
transformers
safetensors
gpt2
text-generation
causal-lm
text-generation-inference
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
nikitastheo/mixed-ell-ell-sequential_interleaved
Trained with train_clm.py, a Hugging Face Accelerate causal-LM training script (no
Trainer
).
Training details
Base config
:
gpt_base_config.json
Tokenizer
:
nikitastheo/mixed-ell-ell-tokenizer
Max steps
: 24930
Learning rate
: 0.0001
LR scheduler
: linear
Warmup steps
: 2493
Batch size (per device)
: 32
Gradient accumulation steps
: 1
Total train batch size
: 32
Language switch epoch
: 10