Beta
Explore
Marketplace
Neural Labs
Playground
Wallet
Docs
ggml-vicuna-7b-4bit – AI Model by chharlesonfire | AlphaNeural AI
You can deploy this model and start earning money today!
chharlesonfire
/
ggml-vicuna-7b-4bit
like
0
apache-2.0
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
convert ggml-vicuna-7b-f16 to ggml-vicuna-7b-q4_0
Source:
https://huggingface.co/chharlesonfire/ggml-vicuna-7b-f16
No unnecessary changes
Usage:
Download llama.cpp from
https://github.com/ggerganov/llama.cpp
make and run llama.cpp and choose model with ggml-vicuna-7b-q4_0.bin
