You can deploy this model and start earning money today!

RichardErkhov/
Casual-Autopsy_-_L3-Umbral-Mind-RP-v0.3-8B-gguf

Name: Casual-Autopsy_-_L3-Umbral-Mind-RP-v0.3-8B-gguf
Availability: InStock

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

L3-Umbral-Mind-RP-v0.3-8B - GGUF

Model creator: https://huggingface.co/Casual-Autopsy/
Original model: https://huggingface.co/Casual-Autopsy/L3-Umbral-Mind-RP-v0.3-8B/

Name	Quant method	Size
L3-Umbral-Mind-RP-v0.3-8B.Q2_K.gguf	Q2_K	2.96GB
L3-Umbral-Mind-RP-v0.3-8B.IQ3_XS.gguf	IQ3_XS	3.28GB
L3-Umbral-Mind-RP-v0.3-8B.IQ3_S.gguf	IQ3_S	3.43GB
L3-Umbral-Mind-RP-v0.3-8B.Q3_K_S.gguf	Q3_K_S	3.41GB
L3-Umbral-Mind-RP-v0.3-8B.IQ3_M.gguf	IQ3_M	3.52GB
L3-Umbral-Mind-RP-v0.3-8B.Q3_K.gguf	Q3_K	3.74GB
L3-Umbral-Mind-RP-v0.3-8B.Q3_K_M.gguf	Q3_K_M	3.74GB
L3-Umbral-Mind-RP-v0.3-8B.Q3_K_L.gguf	Q3_K_L	4.03GB
L3-Umbral-Mind-RP-v0.3-8B.IQ4_XS.gguf	IQ4_XS	4.18GB
L3-Umbral-Mind-RP-v0.3-8B.Q4_0.gguf	Q4_0	4.34GB
L3-Umbral-Mind-RP-v0.3-8B.IQ4_NL.gguf	IQ4_NL	4.38GB
L3-Umbral-Mind-RP-v0.3-8B.Q4_K_S.gguf	Q4_K_S	4.37GB
L3-Umbral-Mind-RP-v0.3-8B.Q4_K.gguf	Q4_K	4.58GB
L3-Umbral-Mind-RP-v0.3-8B.Q4_K_M.gguf	Q4_K_M	4.58GB
L3-Umbral-Mind-RP-v0.3-8B.Q4_1.gguf	Q4_1	4.78GB
L3-Umbral-Mind-RP-v0.3-8B.Q5_0.gguf	Q5_0	5.21GB
L3-Umbral-Mind-RP-v0.3-8B.Q5_K_S.gguf	Q5_K_S	5.21GB
L3-Umbral-Mind-RP-v0.3-8B.Q5_K.gguf	Q5_K	5.34GB
L3-Umbral-Mind-RP-v0.3-8B.Q5_K_M.gguf	Q5_K_M	5.34GB
L3-Umbral-Mind-RP-v0.3-8B.Q5_1.gguf	Q5_1	5.65GB
L3-Umbral-Mind-RP-v0.3-8B.Q6_K.gguf	Q6_K	6.14GB
L3-Umbral-Mind-RP-v0.3-8B.Q8_0.gguf	Q8_0	7.95GB

Original model description:

tags:

merge
mergekit
lazymergekit
not-for-all-audiences
nsfw
rp
roleplay
role-play license: llama3 language:
en library_name: transformers pipeline_tag: text-generation base_model:
Sao10K/L3-8B-Stheno-v3.2
Hastagaras/Jamet-8B-L3-MK.V-Blackroot
grimjim/Llama-3-Oasis-v1-OAS-8B
Casual-Autopsy/SOVL-MopeyMule-8B
Casual-Autopsy/MopeyMule-Blackroot-8B
ResplendentAI/Theory_of_Mind_Llama3
ResplendentAI/RP_Format_QuoteAsterisk_Llama3
ResplendentAI/Smarts_Llama3

Image by ろ47

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

The goal of this merge was to make an RP model better suited for role-plays with heavy themes such as but not limited to:

Mental illness
Self-harm
Trauma
Suicide

I hated how RP models tended to be overly positive and hopeful with role-plays involving such themes, but thanks to failspy/Llama-3-8B-Instruct-MopeyMule this problem has been lessened considerably.

If you're an enjoyer of savior/reverse savior type role-plays like myself, then this bot is for you.

Compared to v1, v3 has better intelligence, fewer GPTisms, and much more human-like responses compared to before. Having MopeyMule merge with RP LoRAs also seems to have increased its effectiveness in changing the tone of RP LLMs, so feel free to use the MopeyMule mergers I made for your own merges:

Quants

L3-Umbral-Mind-RP-v3-8B-i1-GGUF by mradermacher
L3-Umbral-Mind-RP-v3-8B-8bpw-h8-exl2 by riveRiPH

Merge Method

This model was merged using several Task Arithmetic merges and then tied together with a Model Stock merge.

Models Merged

The following models were included in the merge:

Casual-Autopsy/Umbral-v3-1 + ResplendentAI/Theory_of_Mind_Llama3
Casual-Autopsy/Umbral-v3-2 + ResplendentAI/Smarts_Llama3
Casual-Autopsy/Umbral-v3-3 + ResplendentAI/RP_Format_QuoteAsterisk_Llama3

Secret Sauce

The following YAML configurations were used to produce this model:

Umbral-v3-1

yaml

slices:
- sources:
  - model: Sao10K/L3-8B-Stheno-v3.2
    layer_range: [0, 32]
    parameters:
      weight: 0.65
  - model: Casual-Autopsy/SOVL-MopeyMule-8B
    layer_range: [0, 32]
    parameters:
      weight: 0.25
  - model: Casual-Autopsy/MopeyMule-Blackroot-8B
    layer_range: [0, 32]
    parameters:
      weight: 0.1
merge_method: task_arithmetic
base_model: Sao10K/L3-8B-Stheno-v3.2
normalize: False
dtype: bfloat16

Umbral-v3-2

yaml

slices:
- sources:
  - model: Hastagaras/Jamet-8B-L3-MK.V-Blackroot
    layer_range: [0, 32]
    parameters:
      weight: 0.75
  - model: Casual-Autopsy/SOVL-MopeyMule-8B
    layer_range: [0, 32]
    parameters:
      weight: 0.15
  - model: Casual-Autopsy/MopeyMule-Blackroot-8B
    layer_range: [0, 32]
    parameters:
      weight: 0.1
merge_method: task_arithmetic
base_model: Hastagaras/Jamet-8B-L3-MK.V-Blackroot
normalize: False
dtype: bfloat16

Umbral-v3-3

yaml

slices:
- sources:
  - model: grimjim/Llama-3-Oasis-v1-OAS-8B
    layer_range: [0, 32]
    parameters:
      weight: 0.55
  - model: Casual-Autopsy/SOVL-MopeyMule-8B
    layer_range: [0, 32]
    parameters:
      weight: 0.35
  - model: Casual-Autopsy/MopeyMule-Blackroot-8B
    layer_range: [0, 32]
    parameters:
      weight: 0.1
merge_method: task_arithmetic
base_model: grimjim/Llama-3-Oasis-v1-OAS-8B
normalize: False
dtype: bfloat16

Umbral-Mind-RP-8B

yaml

models:
  - model: Casual-Autopsy/Umbral-v3-1+ResplendentAI/Theory_of_Mind_Llama3
  - model: Casual-Autopsy/Umbral-v3-2+ResplendentAI/Smarts_Llama3
  - model: Casual-Autopsy/Umbral-v3-3+ResplendentAI/RP_Format_QuoteAsterisk_Llama3
merge_method: model_stock
base_model: Casual-Autopsy/Umbral-v3-1
dtype: bfloat16

RichardErkhov/Casual-Autopsy_-_L3-Umbral-Mind-RP-v0.3-8B-gguf

Original model description:

merge

Merge Details

Quants

Merge Method

Models Merged

Secret Sauce

Umbral-v3-1

Umbral-v3-2

Umbral-v3-3

Umbral-Mind-RP-8B

RichardErkhov/
Casual-Autopsy_-_L3-Umbral-Mind-RP-v0.3-8B-gguf