Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
rwkv-minipile – AI Model by leliuga | AlphaNeural AI
You can deploy this model and start earning money today!
leliuga
/
rwkv-minipile
like
0
en
JeanKaddour/minipile
mpl-2.0
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
RWKV Minipile
Model Specifications
Architecture
: RWKV
Vocabulary Size
: 65,536
Embedding Size
: 768
Number of Layers
: 12
Context Length
: 512
Data Type
: bfloat16
Dataset
: Minipile
Tokens
: 20,643,840 (20 Million)
The model underwent a rigorous training regimen, completing 32 epochs to optimize performance.
Wandb
Training progress
Verifying checksums
sha512sum -c sha512sums.txt
Inference
bash
1
pip
install
torch numpy
2
3
python inference.py