You can deploy this model and start earning money today!

lainlives/
Qwen2.5-RP-14B-bnb-nf4

Quantization Type: int4
bnb_4bit_quant_type: nf4
bnb_4bit_use_double_quant: True
bnb_4bit_compute_dtype: bfloat16
bnb_4bit_quant_storage: uint8

Name: Qwen2.5-RP-14B-bnb-nf4
Availability: InStock

Views

No views yet

lainlives/Qwen2.5-RP-14b (Quantized)

This model is a quantized version of the original model lainlives/Qwen2.5-RP-14b.

It's quantized using the BitsAndBytes library to 4-bit using the bnb-my-repo space.