Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Linear_pruned_RedPajama3B – AI Model by Advaith28 | AlphaNeural AI
You can deploy this model and start earning money today!
Advaith28
/
Linear_pruned_RedPajama3B
like
0
transformers
safetensors
gpt_neox
text-generation
autotrain_compatible
text-generation-inference
endpoints_compatible
8-bit
bitsandbytes
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
33% pruning on RedPajama 3B linear layers
The pruned layers are:
attention linear layers (query, key, value computation)
attention dense layer
MLP layers
Pruning is done in all decoder modules. Pruning is unstructured magnitude pruning