Beta
Explore
Marketplace
Neural Labs
Playground
Wallet
Docs
vtubers-4-bnb-4bit – AI Model by fakeavatar | AlphaNeural AI | AlphaNeural AI
You can deploy this model and start earning money today!
fakeavatar
/
vtubers-4-bnb-4bit
like
0
safetensors
llama
bnb-my-repo
fakeavatar/vtubers-4
quantized
cc-by-nc-4.0
4-bit
bitsandbytes
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
fakeavatar/vtubers-4 (Quantized)
Description
This model is a quantized version of the original model
fakeavatar/vtubers-4
.
It's quantized using the BitsAndBytes library to 4-bit using the
bnb-my-repo
space.
Quantization Details
Quantization Type
: int4
bnb_4bit_quant_type
: nf4
bnb_4bit_use_double_quant
: True
bnb_4bit_compute_dtype
: bfloat16
bnb_4bit_quant_storage
: uint8