Beta
Explore
Marketplace
Neural Labs
Playground
Wallet
Docs
gpt-python-modern-114m – AI Model by devoppro | AlphaNeural AI
You can deploy this model and start earning money today!
devoppro
/
gpt-python-modern-114m
like
0
pytorch
gpt
from-scratch
code-generation
rope
gqa
swiglu
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
gpt-python-modern-114m
A ~114M parameter LLaMA/Mistral-style decoder-only transformer (RMSNorm, RoPE, SwiGLU, Grouped Query Attention), trained from scratch on
devoppro/Python
.
Layers: 12, Query heads: 12, KV heads: 4
Embedding dim: 768
Context length: 512
Trained to step 0, val loss 10.3440
Tokenizer: GPT-2 BPE (tiktoken 'gpt2')
