Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
phonebabylm-text-deu-eng-interleaved – AI Model by nikitastheo | AlphaNeural AI
You can deploy this model and start earning money today!
nikitastheo
/
phonebabylm-text-deu-eng-interleaved
like
0
transformers
safetensors
gpt2
text-generation
causal-lm
text-generation-inference
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
nikitastheo/phonebabylm-text-deu-eng-interleaved
Trained with train_clm.py, a Hugging Face Accelerate causal-LM training script (no
Trainer
).
Training details
Base config
:
gpt_base_config.json
Tokenizer
:
nikitastheo/phonelm-text-deu-eng-tokenizer
Max steps
: 40000
Learning rate
: 0.0001
LR scheduler
: linear
Warmup steps
: 4000
Batch size (per device)
: 32
Gradient accumulation steps
: 1
Total train batch size
: 32