You can deploy this model and start earning money today!

RichardErkhov/
byroneverson_-_glm-4-9b-chat-abliterated-gguf

Name: byroneverson_-_glm-4-9b-chat-abliterated-gguf
Availability: InStock

Views

No views yet

Quantization made by Richard Erkhov.

glm-4-9b-chat-abliterated - GGUF

Name	Quant method	Size
glm-4-9b-chat-abliterated.Q2_K.gguf	Q2_K	3.72GB
glm-4-9b-chat-abliterated.IQ3_XS.gguf	IQ3_XS	4.13GB
glm-4-9b-chat-abliterated.IQ3_S.gguf	IQ3_S	4.27GB
glm-4-9b-chat-abliterated.Q3_K_S.gguf	Q3_K_S	4.27GB
glm-4-9b-chat-abliterated.IQ3_M.gguf	IQ3_M	4.48GB
glm-4-9b-chat-abliterated.Q3_K.gguf	Q3_K	4.72GB
glm-4-9b-chat-abliterated.Q3_K_M.gguf	Q3_K_M	4.72GB
glm-4-9b-chat-abliterated.Q3_K_L.gguf	Q3_K_L	4.92GB
glm-4-9b-chat-abliterated.IQ4_XS.gguf	IQ4_XS	4.94GB
glm-4-9b-chat-abliterated.Q4_0.gguf	Q4_0	5.08GB
glm-4-9b-chat-abliterated.IQ4_NL.gguf	IQ4_NL	5.13GB
glm-4-9b-chat-abliterated.Q4_K_S.gguf	Q4_K_S	5.36GB
glm-4-9b-chat-abliterated.Q4_K.gguf	Q4_K	5.82GB
glm-4-9b-chat-abliterated.Q4_K_M.gguf	Q4_K_M	5.82GB
glm-4-9b-chat-abliterated.Q4_1.gguf	Q4_1	5.59GB
glm-4-9b-chat-abliterated.Q5_0.gguf	Q5_0	6.1GB
glm-4-9b-chat-abliterated.Q5_K_S.gguf	Q5_K_S	6.23GB
glm-4-9b-chat-abliterated.Q5_K.gguf	Q5_K	6.65GB
glm-4-9b-chat-abliterated.Q5_K_M.gguf	Q5_K_M	6.65GB
glm-4-9b-chat-abliterated.Q5_1.gguf	Q5_1	6.61GB
glm-4-9b-chat-abliterated.Q6_K.gguf	Q6_K	7.69GB
glm-4-9b-chat-abliterated.Q8_0.gguf	Q8_0	9.31GB

Original model description:

base_model: THUDM/glm-4-9b-chat pipeline_tag: text-generation license: other license_name: glm-4 license_link: https://huggingface.co/THUDM/glm-4-9b-chat/blob/main/LICENSE language:

Check out the jupyter notebook for details of how this model was abliterated from glm-4-9b-chat.

The python package "tiktoken" is required to quantize the model into gguf format. So I had to create a fork of GGUF My Repo (+tiktoken).

Logo