You can deploy this model and start earning money today!

RichardErkhov/
HiroseKoichi_-_L3-8B-Lunar-Stheno-gguf

Name: HiroseKoichi_-_L3-8B-Lunar-Stheno-gguf
Availability: InStock

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

L3-8B-Lunar-Stheno - GGUF

Model creator: https://huggingface.co/HiroseKoichi/
Original model: https://huggingface.co/HiroseKoichi/L3-8B-Lunar-Stheno/

Name	Quant method	Size
L3-8B-Lunar-Stheno.Q2_K.gguf	Q2_K	2.96GB
L3-8B-Lunar-Stheno.IQ3_XS.gguf	IQ3_XS	3.28GB
L3-8B-Lunar-Stheno.IQ3_S.gguf	IQ3_S	3.43GB
L3-8B-Lunar-Stheno.Q3_K_S.gguf	Q3_K_S	3.41GB
L3-8B-Lunar-Stheno.IQ3_M.gguf	IQ3_M	3.52GB
L3-8B-Lunar-Stheno.Q3_K.gguf	Q3_K	3.74GB
L3-8B-Lunar-Stheno.Q3_K_M.gguf	Q3_K_M	3.74GB
L3-8B-Lunar-Stheno.Q3_K_L.gguf	Q3_K_L	4.03GB
L3-8B-Lunar-Stheno.IQ4_XS.gguf	IQ4_XS	4.18GB
L3-8B-Lunar-Stheno.Q4_0.gguf	Q4_0	4.34GB
L3-8B-Lunar-Stheno.IQ4_NL.gguf	IQ4_NL	4.38GB
L3-8B-Lunar-Stheno.Q4_K_S.gguf	Q4_K_S	4.37GB
L3-8B-Lunar-Stheno.Q4_K.gguf	Q4_K	4.58GB
L3-8B-Lunar-Stheno.Q4_K_M.gguf	Q4_K_M	4.58GB
L3-8B-Lunar-Stheno.Q4_1.gguf	Q4_1	4.78GB
L3-8B-Lunar-Stheno.Q5_0.gguf	Q5_0	5.21GB
L3-8B-Lunar-Stheno.Q5_K_S.gguf	Q5_K_S	5.21GB
L3-8B-Lunar-Stheno.Q5_K.gguf	Q5_K	5.34GB
L3-8B-Lunar-Stheno.Q5_K_M.gguf	Q5_K_M	5.34GB
L3-8B-Lunar-Stheno.Q5_1.gguf	Q5_1	5.65GB
L3-8B-Lunar-Stheno.Q6_K.gguf	Q6_K	6.14GB
L3-8B-Lunar-Stheno.Q8_0.gguf	Q8_0	7.95GB

Original model description:

license: llama3 library_name: transformers tags:

nsfw
not-for-all-audiences
llama-3
text-generation-inference
mergekit
merge

L3-8B-Lunar-Stheno

L3-8B-Lunaris-v1 is definitely a significant improvement over L3-8B-Stheno-v3.2 in terms of situational awareness and prose, but it's not without issues: the response length can sometimes be very long, causing it to go on a rant; it tends to not take direct action, saying that it will do something but never actually doing it; and its performance outside of roleplay took a hit.

This merge fixes all of those issues, and I'm genuinely impressed with the results. While I did use a SLERP merge to create this model, there was no blending of the models; all I did was replace L3-8B-Stheno-v3.2's weights with L3-8B-Lunaris-v1's.

Quantization Formats

GGUF

Details

License: llama3
Instruct Format: llama-3
Context Size: 8K

Models Used

Merge Config

yaml

models:
    - model: Sao10K/L3-8B-Stheno-v3.2
    - model: Sao10K/L3-8B-Lunaris-v1
merge_method: slerp
base_model: Sao10K/L3-8B-Stheno-v3.2
parameters:
  t:
    - filter: self_attn
      value: 0
    - filter: mlp
      value: 1
    - value: 0
dtype: bfloat16

RichardErkhov/HiroseKoichi_-_L3-8B-Lunar-Stheno-gguf