You can deploy this model and start earning money today!

RichardErkhov/
Darkknight535_-_OpenCrystal-12B-L3.1-128K-gguf

Name: Darkknight535_-_OpenCrystal-12B-L3.1-128K-gguf
Availability: InStock

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

OpenCrystal-12B-L3.1-128K - GGUF

Model creator: https://huggingface.co/Darkknight535/
Original model: https://huggingface.co/Darkknight535/OpenCrystal-12B-L3.1-128K/

Name	Quant method	Size
OpenCrystal-12B-L3.1-128K.Q2_K.gguf	Q2_K	4.16GB
OpenCrystal-12B-L3.1-128K.IQ3_XS.gguf	IQ3_XS	4.61GB
OpenCrystal-12B-L3.1-128K.IQ3_S.gguf	IQ3_S	4.83GB
OpenCrystal-12B-L3.1-128K.Q3_K_S.gguf	Q3_K_S	4.81GB
OpenCrystal-12B-L3.1-128K.IQ3_M.gguf	IQ3_M	4.98GB
OpenCrystal-12B-L3.1-128K.Q3_K.gguf	Q3_K	5.3GB
OpenCrystal-12B-L3.1-128K.Q3_K_M.gguf	Q3_K_M	5.3GB
OpenCrystal-12B-L3.1-128K.Q3_K_L.gguf	Q3_K_L	5.73GB
OpenCrystal-12B-L3.1-128K.IQ4_XS.gguf	IQ4_XS	5.93GB
OpenCrystal-12B-L3.1-128K.Q4_0.gguf	Q4_0	6.17GB
OpenCrystal-12B-L3.1-128K.IQ4_NL.gguf	IQ4_NL	6.23GB
OpenCrystal-12B-L3.1-128K.Q4_K_S.gguf	Q4_K_S	6.21GB
OpenCrystal-12B-L3.1-128K.Q4_K.gguf	Q4_K	6.53GB
OpenCrystal-12B-L3.1-128K.Q4_K_M.gguf	Q4_K_M	6.53GB
OpenCrystal-12B-L3.1-128K.Q4_1.gguf	Q4_1	6.81GB
OpenCrystal-12B-L3.1-128K.Q5_0.gguf	Q5_0	7.45GB
OpenCrystal-12B-L3.1-128K.Q5_K_S.gguf	Q5_K_S	7.45GB
OpenCrystal-12B-L3.1-128K.Q5_K.gguf	Q5_K	7.64GB
OpenCrystal-12B-L3.1-128K.Q5_K_M.gguf	Q5_K_M	7.64GB
OpenCrystal-12B-L3.1-128K.Q5_1.gguf	Q5_1	8.09GB
OpenCrystal-12B-L3.1-128K.Q6_K.gguf	Q6_K	8.81GB
OpenCrystal-12B-L3.1-128K.Q8_0.gguf	Q8_0	11.41GB

Original model description:

library_name: transformers tags:

mergekit
merge
not-for-all-audiences

OpenCrystal-12B-L3.1 (128K)

This is a merge of pre-trained language models created using mergekit.

NOTE

I've not tested this model yet, it's just a 128K (llama 3.1) variant of OpenCrystal-12B-L3, so do provide feedback.

FeedBack

FeedBack here

Instruct Template

Default llama3 instruct and context preset, but here is the one i use. Instruct Context

Samplers

Creative

Temp : 1.23
Min P : 0.05
Repetition Penalty : 1.05

[And everything else neutral]

Normal

Temp : 0.8
Min P : 0.1
Repetition Penalty : 1.1

[And everything else neutral]

Pro Tip

You can uncheck Include Names option in sillytavern, to force it to speak as others dynamically. Not Recommended

Features

Can speak as other npc automatically.
Creative
Coherent (Sometime gets horny)
(it's llama 3.1 so you know, not good as llama 3)
can summarize and generate image prompts well.

Instruct Prompt

You're {{char}}, follow {{char}} personality and plot of the story, Don't impersonate as {{user}}, Speak as others NPC except {{user}} when needed. Be Creative, Create various interesting events and situations during the story.

RichardErkhov/Darkknight535_-_OpenCrystal-12B-L3.1-128K-gguf