Bielik-11B-v2.2-Instruct-Quanto-4bit – AI Model by speakleash | AlphaNeural AI

You can deploy this model and start earning money today!

speakleash/
Bielik-11B-v2.2-Instruct-Quanto-4bit

like

0

text-generation

speakleash/Bielik-11B-v2.2-Instruct

autotrain_compatible

text-generation-inference

Views

No views yet

Bielik-11B-v2.2-Instruct-Quanto-4bit

This model was converted to Quanto format from SpeakLeash's Bielik-11B-v.2.2-Instruct.

DISCLAIMER: Be aware that quantised models show reduced response quality and possible hallucinations!

About Quanto

Optimum Quanto is a pytorch quantization backend for optimum. Model can be loaded using:

from optimum.quanto import QuantizedModelForCausalLM

qmodel = QuantizedModelForCausalLM.from_pretrained('speakleash/Bielik-11B-v2.2-Instruct-Quanto-4bit')

Model description:

Responsible for model quantization

Remigiusz Kinas^SpeakLeash - team leadership, conceptualizing, calibration data preparation, process creation and quantized model delivery.

Contact Us

If you have any questions or suggestions, please use the discussion tab. If you want to contact us directly, join our Discord SpeakLeash.