Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
llama-13b-pretrained-dropout-hf-int4-128g – AI Model by zatochu | AlphaNeural AI
You can deploy this model and start earning money today!
zatochu
/
llama-13b-pretrained-dropout-hf-int4-128g
like
0
transformers
pytorch
llama
text-generation
autotrain_compatible
text-generation-inference
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Original description
https://wandb.ai/open-assistant/supervised-finetuning/runs/i9gmn0dt
Trained with residual dropout 0.1
What is this
This is
https://huggingface.co/dvruette/llama-13b-pretrained-dropout
quantized to int4, groupsize 128.
Run in text-generation-webui with --wbits 4 and --groupsize 128.
