This is a 8bpw EXL2 quant of PJMixers/LLaMa-3-Stheno-v3.2-15B

This quant was made using exllamav2-0.0.21 with default dataset.

I tested this quant shortly in some random RPs (including one over 8k context - with RoPE scaling as recommended in webui, maybe with alpha_value a bit higher) and it seems to work fine.

During quanting I noticed that a lot of layers in the middle of the model had suspiciously low error values, this resulted in lower quant size as the script must have thought that these layers weren't important and used lower bpw for them. Despite this the model seems to work well, at leat for me.

Seems to use llama3 prompt template.

This is a merge of pre-trained language models created using mergekit.

This model was merged using the task arithmetic merge method using elinas/Llama-3-15B-Instruct-zeroed as a base.

The following models were included in the merge:

The following YAML configuration was used to produce this model: