You can deploy this model and start earning money today!

wheattoast11/
utopia-atomic-bnb-4bit

Quantization Type: int4
bnb_4bit_quant_type: fp4
bnb_4bit_use_double_quant: True
bnb_4bit_compute_dtype: bfloat16
bnb_4bit_quant_storage: uint8

Name: utopia-atomic-bnb-4bit
Availability: InStock

Views

No views yet

wheattoast11/utopia-atomic (Quantized)

This model is a quantized version of the original model wheattoast11/utopia-atomic.

It's quantized using the BitsAndBytes library to 4-bit using the bnb-my-repo space.