You can deploy this model and start earning money today!

RichardErkhov/
allknowingroger_-_YiSM-blossom5.1-40B-gguf

Name: allknowingroger_-_YiSM-blossom5.1-40B-gguf
Availability: InStock

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

YiSM-blossom5.1-40B - GGUF

Model creator: https://huggingface.co/allknowingroger/
Original model: https://huggingface.co/allknowingroger/YiSM-blossom5.1-40B/

Name	Quant method	Size
YiSM-blossom5.1-40B.Q2_K.gguf	Q2_K	13.85GB
YiSM-blossom5.1-40B.IQ3_XS.gguf	IQ3_XS	15.37GB
YiSM-blossom5.1-40B.IQ3_S.gguf	IQ3_S	16.23GB
YiSM-blossom5.1-40B.Q3_K_S.gguf	Q3_K_S	16.17GB
YiSM-blossom5.1-40B.IQ3_M.gguf	IQ3_M	16.82GB
YiSM-blossom5.1-40B.Q3_K.gguf	Q3_K	18.02GB
YiSM-blossom5.1-40B.Q3_K_M.gguf	Q3_K_M	18.02GB
YiSM-blossom5.1-40B.Q3_K_L.gguf	Q3_K_L	19.62GB
YiSM-blossom5.1-40B.IQ4_XS.gguf	IQ4_XS	20.15GB
YiSM-blossom5.1-40B.Q4_0.gguf	Q4_0	21.05GB
YiSM-blossom5.1-40B.IQ4_NL.gguf	IQ4_NL	21.25GB
YiSM-blossom5.1-40B.Q4_K_S.gguf	Q4_K_S	21.19GB
YiSM-blossom5.1-40B.Q4_K.gguf	Q4_K	22.31GB
YiSM-blossom5.1-40B.Q4_K_M.gguf	Q4_K_M	22.31GB
YiSM-blossom5.1-40B.Q4_1.gguf	Q4_1	23.35GB
YiSM-blossom5.1-40B.Q5_0.gguf	Q5_0	25.65GB
YiSM-blossom5.1-40B.Q5_K_S.gguf	Q5_K_S	25.65GB
YiSM-blossom5.1-40B.Q5_K.gguf	Q5_K	26.3GB
YiSM-blossom5.1-40B.Q5_K_M.gguf	Q5_K_M	26.3GB
YiSM-blossom5.1-40B.Q5_1.gguf	Q5_1	27.95GB
YiSM-blossom5.1-40B.Q6_K.gguf	Q6_K	30.54GB
YiSM-blossom5.1-40B.Q8_0.gguf	Q8_0	39.55GB

Original model description:

base_model:

CombinHorizon/YiSM-blossom5.1-34B-SLERP library_name: transformers tags:
mergekit
merge license: apache-2.0

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the passthrough merge method.

Models Merged

The following models were included in the merge:

CombinHorizon/YiSM-blossom5.1-34B-SLERP

Configuration

The following YAML configuration was used to produce this model:

yaml

slices:
  - sources:
    - model: CombinHorizon/YiSM-blossom5.1-34B-SLERP
      layer_range: [0, 39]
  - sources:
    - model: CombinHorizon/YiSM-blossom5.1-34B-SLERP
      layer_range: [8, 39]
merge_method: passthrough
dtype: bfloat16

RichardErkhov/allknowingroger_-_YiSM-blossom5.1-40B-gguf