You can deploy this model and start earning money today!

RichardErkhov/
saishf_-_Merge-Mayhem-L3-V2-gguf

Name: saishf_-_Merge-Mayhem-L3-V2-gguf
Availability: InStock

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

Merge-Mayhem-L3-V2 - GGUF

Model creator: https://huggingface.co/saishf/
Original model: https://huggingface.co/saishf/Merge-Mayhem-L3-V2/

Name	Quant method	Size
Merge-Mayhem-L3-V2.Q2_K.gguf	Q2_K	2.96GB
Merge-Mayhem-L3-V2.Q3_K_S.gguf	Q3_K_S	3.41GB
Merge-Mayhem-L3-V2.Q3_K.gguf	Q3_K	3.74GB
Merge-Mayhem-L3-V2.Q3_K_M.gguf	Q3_K_M	3.74GB
Merge-Mayhem-L3-V2.Q3_K_L.gguf	Q3_K_L	4.03GB
Merge-Mayhem-L3-V2.IQ4_XS.gguf	IQ4_XS	4.18GB
Merge-Mayhem-L3-V2.Q4_0.gguf	Q4_0	4.34GB
Merge-Mayhem-L3-V2.IQ4_NL.gguf	IQ4_NL	4.38GB
Merge-Mayhem-L3-V2.Q4_K_S.gguf	Q4_K_S	4.37GB
Merge-Mayhem-L3-V2.Q4_K.gguf	Q4_K	4.58GB
Merge-Mayhem-L3-V2.Q4_K_M.gguf	Q4_K_M	4.58GB
Merge-Mayhem-L3-V2.Q4_1.gguf	Q4_1	4.78GB
Merge-Mayhem-L3-V2.Q5_0.gguf	Q5_0	5.21GB
Merge-Mayhem-L3-V2.Q5_K_S.gguf	Q5_K_S	5.21GB
Merge-Mayhem-L3-V2.Q5_K.gguf	Q5_K	5.34GB
Merge-Mayhem-L3-V2.Q5_K_M.gguf	Q5_K_M	5.34GB
Merge-Mayhem-L3-V2.Q5_1.gguf	Q5_1	5.65GB
Merge-Mayhem-L3-V2.Q6_K.gguf	Q6_K	6.14GB
Merge-Mayhem-L3-V2.Q8_0.gguf	Q8_0	7.95GB

Original model description:

license: cc-by-nc-4.0 base_model:

Undi95/Meta-Llama-3-8B-Instruct-hf
ResplendentAI/RP_Format_QuoteAsterisk_Llama3
Undi95/Meta-Llama-3-8B-Instruct-hf
ResplendentAI/Smarts_Llama3
Undi95/Meta-Llama-3-8B-Instruct-hf
ResplendentAI/Luna_Llama3
Undi95/Meta-Llama-3-8B-Instruct-hf
ResplendentAI/BlueMoon_Llama3
openlynn/Llama-3-Soliloquy-8B-v2
Undi95/Meta-Llama-3-8B-Instruct-hf
ResplendentAI/Aura_Llama3 library_name: transformers tags:
mergekit
merge

Quants

mradermacher has kindly provided quants here: mradermacher/Merge-Mayhem-L3-V2-GGUF

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

This is quite an interesting model, it's fun so far. But quite harsh, so if that's something you don't like, this model isn't for you :3

it's an attempt at loosely recreating ResplendentAI/SOVL_Llama3_8B but trying to keep it smarter, with the lovely openlynn/Llama-3-Soliloquy-8B-v2 holding it together. I'm personally enjoying this model, it's different from most llama-3 models.

Merge Method

This model was merged using the Model Stock merge method using openlynn/Llama-3-Soliloquy-8B-v2 as a base.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

yaml

models:
  - model: Undi95/Meta-Llama-3-8B-Instruct-hf+ResplendentAI/Aura_Llama3
  - model: Undi95/Meta-Llama-3-8B-Instruct-hf+ResplendentAI/Smarts_Llama3
  - model: Undi95/Meta-Llama-3-8B-Instruct-hf+ResplendentAI/Luna_Llama3
  - model: Undi95/Meta-Llama-3-8B-Instruct-hf+ResplendentAI/BlueMoon_Llama3
  - model: Undi95/Meta-Llama-3-8B-Instruct-hf+ResplendentAI/RP_Format_QuoteAsterisk_Llama3
merge_method: model_stock
base_model: openlynn/Llama-3-Soliloquy-8B-v2
dtype: float16

RichardErkhov/saishf_-_Merge-Mayhem-L3-V2-gguf