You can deploy this model and start earning money today!

RichardErkhov/
elinas_-_Chronos-Gold-12B-1.0-gguf

Name: elinas_-_Chronos-Gold-12B-1.0-gguf
Availability: InStock

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

Chronos-Gold-12B-1.0 - GGUF

Model creator: https://huggingface.co/elinas/
Original model: https://huggingface.co/elinas/Chronos-Gold-12B-1.0/

Name	Quant method	Size
Chronos-Gold-12B-1.0.Q2_K.gguf	Q2_K	4.46GB
Chronos-Gold-12B-1.0.IQ3_XS.gguf	IQ3_XS	4.94GB
Chronos-Gold-12B-1.0.IQ3_S.gguf	IQ3_S	5.18GB
Chronos-Gold-12B-1.0.Q3_K_S.gguf	Q3_K_S	5.15GB
Chronos-Gold-12B-1.0.IQ3_M.gguf	IQ3_M	5.33GB
Chronos-Gold-12B-1.0.Q3_K.gguf	Q3_K	5.67GB
Chronos-Gold-12B-1.0.Q3_K_M.gguf	Q3_K_M	5.67GB
Chronos-Gold-12B-1.0.Q3_K_L.gguf	Q3_K_L	6.11GB
Chronos-Gold-12B-1.0.IQ4_XS.gguf	IQ4_XS	6.33GB
Chronos-Gold-12B-1.0.Q4_0.gguf	Q4_0	6.59GB
Chronos-Gold-12B-1.0.IQ4_NL.gguf	IQ4_NL	6.65GB
Chronos-Gold-12B-1.0.Q4_K_S.gguf	Q4_K_S	6.63GB
Chronos-Gold-12B-1.0.Q4_K.gguf	Q4_K	6.96GB
Chronos-Gold-12B-1.0.Q4_K_M.gguf	Q4_K_M	6.96GB
Chronos-Gold-12B-1.0.Q4_1.gguf	Q4_1	7.26GB
Chronos-Gold-12B-1.0.Q5_0.gguf	Q5_0	7.93GB
Chronos-Gold-12B-1.0.Q5_K_S.gguf	Q5_K_S	7.93GB
Chronos-Gold-12B-1.0.Q5_K.gguf	Q5_K	8.13GB
Chronos-Gold-12B-1.0.Q5_K_M.gguf	Q5_K_M	8.13GB
Chronos-Gold-12B-1.0.Q5_1.gguf	Q5_1	8.61GB
Chronos-Gold-12B-1.0.Q6_K.gguf	Q6_K	9.37GB
Chronos-Gold-12B-1.0.Q8_0.gguf	Q8_0	12.13GB

Original model description:

base_model: mistralai/Mistral-Nemo-Base-2407 license: cc-by-nc-4.0 tags:

general-purpose
roleplay
storywriting
merge
finetune library_name: transformers

Chronos Gold 12B-1.0

Chronos Gold 12B 1.0 is a very unique model that applies to domain areas such as geneal chatbot functionatliy, roleplay, and storywriting. The model has been observed to write up to 2250 tokens in a single sequence. The model was trained at a sequence length of 16384 (16k) and will still retain the apparent 128k context length from Mistral-Nemo.

The base model is mistralai/Mistral-Nemo-Base-2407 which was heavily modified to produce a more coherent model, comparable to much larger models.

Chronos Gold 12B-1.0 re-creates the uniqueness of the original Chronos with significiantly enhanced prompt adherence (following), coherence, a modern dataset, as well as supporting a majority of "character card" formats in applications like SillyTavern.

It went through an iterative and objective merge process as my previous models and was further finetuned on a dataset curated for it.

The specifics of the model will not be disclosed at the time due to dataset ownership.

Instruct Template

This model uses ChatML - below is an example. It is a preset in many frontends.

<|im_start|>system
A system prompt describing how you'd like your bot to act.<|im_end|>
<|im_start|>user
Hello there!<|im_end|>
<|im_start|>assistant
I can assist you or we can disucss other things?<|im_end|>
<|im_start|>user
I was wondering how transformers work?<|im_end|>
<|im_start|>assistant

Quantization

Sampling Settings

Nemo is a bit sensitive to high temperatures, so I use lower. Here are my settings:

Temp - 0.7 (0.9 max)
Presence Penalty - 1.0
Repetition Penalty range - 2800
Min P - 0.10

Additional Details

This model was created by elinas on discord.

This is one of multiple models to come out in the series by size and model architecture, so look forward to it!

Please be mindful of the license. This is strictly non-commercial, but free to use at your own leisure personally. Outputs generated by the model are not reflective of my views.

Contact me on Discord for inquiries.

RichardErkhov/elinas_-_Chronos-Gold-12B-1.0-gguf