You can deploy this model and start earning money today!

lainlives/
codellama-34b-python-merge-bnb

Quantization Type: int4
bnb_4bit_quant_type: nf4
bnb_4bit_use_double_quant: True
bnb_4bit_compute_dtype: bfloat16
bnb_4bit_quant_storage: uint8

Name: codellama-34b-python-merge-bnb
Rating: 2.5 (6 reviews)

Views

No views yet

lainlives/codellama-34b-python-merge (Quantized)

This model is a quantized version of the original model lainlives/codellama-34b-python-merge.

It's quantized using the BitsAndBytes library to 4-bit using the bnb-my-repo space.