TeeZee_-_Qra-13B-chat-gguf – AI Model by RichardErkhov | AlphaNeural AI

You can deploy this model and start earning money today!

RichardErkhov/
TeeZee_-_Qra-13B-chat-gguf

like

0

endpoints_compatible

Views

No views yet

Quantization made by Richard Erkhov.

Request more models

Qra-13B-chat - GGUF

Model creator: https://huggingface.co/TeeZee/
Original model: https://huggingface.co/TeeZee/Qra-13B-chat/

Name	Quant method	Size
Qra-13B-chat.Q2_K.gguf	Q2_K	4.52GB
Qra-13B-chat.IQ3_XS.gguf	IQ3_XS	4.99GB
Qra-13B-chat.IQ3_S.gguf	IQ3_S	5.27GB
Qra-13B-chat.Q3_K_S.gguf	Q3_K_S	5.27GB
Qra-13B-chat.IQ3_M.gguf	IQ3_M	5.57GB
Qra-13B-chat.Q3_K.gguf	Q3_K	5.9GB
Qra-13B-chat.Q3_K_M.gguf	Q3_K_M	5.9GB
Qra-13B-chat.Q3_K_L.gguf	Q3_K_L	6.45GB
Qra-13B-chat.IQ4_XS.gguf	IQ4_XS	6.54GB
Qra-13B-chat.Q4_0.gguf	Q4_0	6.86GB
Qra-13B-chat.IQ4_NL.gguf	IQ4_NL	6.9GB
Qra-13B-chat.Q4_K_S.gguf	Q4_K_S	6.91GB
Qra-13B-chat.Q4_K.gguf	Q4_K	7.33GB
Qra-13B-chat.Q4_K_M.gguf	Q4_K_M	7.33GB
Qra-13B-chat.Q4_1.gguf	Q4_1	7.61GB
Qra-13B-chat.Q5_0.gguf	Q5_0	8.36GB
Qra-13B-chat.Q5_K_S.gguf	Q5_K_S	8.36GB
Qra-13B-chat.Q5_K.gguf	Q5_K	8.6GB
Qra-13B-chat.Q5_K_M.gguf	Q5_K_M	8.6GB
Qra-13B-chat.Q5_1.gguf	Q5_1	9.1GB
Qra-13B-chat.Q6_K.gguf	Q6_K	9.95GB
Qra-13B-chat.Q8_0.gguf	Q8_0	12.88GB

Original model description:

base_model: TeeZee/Qra-13b-instruct language:

en
pl license: llama2 tags:
text-generation-inference
transformers
unsloth
llama
trl
sft datasets:
TeeZee/chat-alpaca-pl-no-refusals

TeeZee/Qra-13B-chat

Developed by: TeeZee
License: llama2
Finetuned from model : TeeZee/Qra-13b-instruct
Finetuned on a PL chat dataset
Alpaca chat format, tested, works fine, can follow chat coherently

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.

All comments are greatly appreciated, download, test and if you appreciate my work, consider buying me my fuel:

Buy Me A Coffee