You can deploy this model and start earning money today!

RichardErkhov/
crestf411_-_nemo-sunfall-v0.6.1-gguf

Name: crestf411_-_nemo-sunfall-v0.6.1-gguf
Availability: InStock

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

nemo-sunfall-v0.6.1 - GGUF

Model creator: https://huggingface.co/crestf411/
Original model: https://huggingface.co/crestf411/nemo-sunfall-v0.6.1/

Name	Quant method	Size
nemo-sunfall-v0.6.1.Q2_K.gguf	Q2_K	4.46GB
nemo-sunfall-v0.6.1.IQ3_XS.gguf	IQ3_XS	4.94GB
nemo-sunfall-v0.6.1.IQ3_S.gguf	IQ3_S	5.18GB
nemo-sunfall-v0.6.1.Q3_K_S.gguf	Q3_K_S	5.15GB
nemo-sunfall-v0.6.1.IQ3_M.gguf	IQ3_M	5.33GB
nemo-sunfall-v0.6.1.Q3_K.gguf	Q3_K	5.67GB
nemo-sunfall-v0.6.1.Q3_K_M.gguf	Q3_K_M	5.67GB
nemo-sunfall-v0.6.1.Q3_K_L.gguf	Q3_K_L	6.11GB
nemo-sunfall-v0.6.1.IQ4_XS.gguf	IQ4_XS	6.33GB
nemo-sunfall-v0.6.1.Q4_0.gguf	Q4_0	6.59GB
nemo-sunfall-v0.6.1.IQ4_NL.gguf	IQ4_NL	6.65GB
nemo-sunfall-v0.6.1.Q4_K_S.gguf	Q4_K_S	6.63GB
nemo-sunfall-v0.6.1.Q4_K.gguf	Q4_K	6.96GB
nemo-sunfall-v0.6.1.Q4_K_M.gguf	Q4_K_M	6.96GB
nemo-sunfall-v0.6.1.Q4_1.gguf	Q4_1	7.26GB
nemo-sunfall-v0.6.1.Q5_0.gguf	Q5_0	7.93GB
nemo-sunfall-v0.6.1.Q5_K_S.gguf	Q5_K_S	7.93GB
nemo-sunfall-v0.6.1.Q5_K.gguf	Q5_K	8.13GB
nemo-sunfall-v0.6.1.Q5_K_M.gguf	Q5_K_M	8.13GB
nemo-sunfall-v0.6.1.Q5_1.gguf	Q5_1	8.61GB
nemo-sunfall-v0.6.1.Q6_K.gguf	Q6_K	9.37GB
nemo-sunfall-v0.6.1.Q8_0.gguf	Q8_0	12.13GB

Original model description:

library_name: transformers tags:

not-for-all-audiences datasets:
crestf411/LimaRP-DS
AI-MO/NuminaMath-CoT

Sunfall (2024-07-31) v0.6.1 on top of https://huggingface.co/mistralai/Mistral-Nemo-Instruct-2407

Experimental. Please give feedback. Begone if you demand perfection.

This experiment is showing potential but it is still early to tell if it is a viable option. Invest your time accordingly.

Mergers/fine-tuners: there is a LoRA of this model. Consider merging that instead of merging this model.

To use lore book tags (example), make sure you use Status: Blue (constant) and write e.g.

Follow the Diamond Law at all costs.

Tags: humor, dark, complex storytelling, intricate characters, immersive.

This model has been trained on context that mimics that of Silly Tavern's Mistral instruct preset with the Always add character's name to prompt turned off.

Recommended stop strings: ["\nYOURCHARNAME", "\n YOURCHARNAME"]

The card has also been trained on content which includes a narrator card, which was used when the content did not mainly revolve around two characters. Future versions will expand on this idea, so forgive the vagueness at this time.

(The Diamond Law is this, although new rules were added: https://files.catbox.moe/d15m3g.txt -- So far results are unclear, but the training was done with this phrase included, and the training data adheres to the law.)

The model has also been trained to do storywriting. The system message ends up looking something like this:

You are an expert storyteller, who can roleplay or write compelling stories. Follow the Diamond Law at all costs. Below is a scenario with character descriptions and content tags. Write a story based on this scenario.

Scenario: The story is about James, blabla.

James is an overweight 63 year old blabla.

Lucy: James's 62 year old wife.

Tags: tag1, tag2, tag3, ...

MMLU-Pro Benchmark: the model performs slightly better than the base instruct model, except for engineering, law, philosophy, psychology. As the primary purpose is roleplay, this benchmark is in place to demonstrate that the model did not become retarded in the training process. Do not expect miracles in other areas.

Mistral Nemo Instruct:

| overall | biology | business | chemistry | computer science | economics | engineering | health | history |  law  | math  | philosophy | physics | psychology | other |
| ------- | ------- | -------- | --------- | ---------------- | --------- | ----------- | ------ | ------- | ----- | ----- | ---------- | ------- | ---------- | ----- |
|   42.15 |   56.52 |    44.00 |     38.89 |            46.15 |     44.44 |       32.26 |  42.31 |   75.00 | 37.14 | 37.21 |      43.75 |   26.83 |      44.00 | 58.62 |
|     161 |      13 |       11 |        14 |                6 |        12 |          10 |     11 |       9 |    13 |    16 |          7 |      11 |         11 |    17 |
|     382 |      23 |       25 |        36 |               13 |        27 |          31 |     26 |      12 |    35 |    43 |         16 |      41 |         25 |    29 |

Nemo Sunfall v0.6.1:

# | overall | biology | business | chemistry | computer science | economics | engineering | health | history |  law  | math  | philosophy | physics | psychology | other |
# | ------- | ------- | -------- | --------- | ---------------- | --------- | ----------- | ------ | ------- | ----- | ----- | ---------- | ------- | ---------- | ----- |
# |   45.29 |   65.22 |    48.00 |     44.44 |            53.85 |     55.56 |       29.03 |  46.15 |   75.00 | 34.29 | 44.19 |      37.50 |   34.15 |      40.00 | 58.62 |
# |     173 |      15 |       12 |        16 |                7 |        15 |           9 |     12 |       9 |    12 |    19 |          6 |      14 |         10 |    17 |
# |     382 |      23 |       25 |        36 |               13 |        27 |          31 |     26 |      12 |    35 |    43 |         16 |      41 |         25 |    29 |

RichardErkhov/crestf411_-_nemo-sunfall-v0.6.1-gguf

Original model description:

RichardErkhov/
crestf411_-_nemo-sunfall-v0.6.1-gguf