You can deploy this model and start earning money today!

RichardErkhov/
archit11_-_Neuralqwen2-0.5B-slerp-gguf

Name: archit11_-_Neuralqwen2-0.5B-slerp-gguf
Availability: InStock

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

Neuralqwen2-0.5B-slerp - GGUF

Model creator: https://huggingface.co/archit11/
Original model: https://huggingface.co/archit11/Neuralqwen2-0.5B-slerp/

Name	Quant method	Size
Neuralqwen2-0.5B-slerp.Q2_K.gguf	Q2_K	0.34GB
Neuralqwen2-0.5B-slerp.Q3_K_S.gguf	Q3_K_S	0.34GB
Neuralqwen2-0.5B-slerp.Q3_K.gguf	Q3_K	0.35GB
Neuralqwen2-0.5B-slerp.Q3_K_M.gguf	Q3_K_M	0.35GB
Neuralqwen2-0.5B-slerp.Q3_K_L.gguf	Q3_K_L	0.36GB
Neuralqwen2-0.5B-slerp.IQ4_XS.gguf	IQ4_XS	0.35GB
Neuralqwen2-0.5B-slerp.Q4_0.gguf	Q4_0	0.35GB
Neuralqwen2-0.5B-slerp.IQ4_NL.gguf	IQ4_NL	0.35GB
Neuralqwen2-0.5B-slerp.Q4_K_S.gguf	Q4_K_S	0.39GB
Neuralqwen2-0.5B-slerp.Q4_K.gguf	Q4_K	0.4GB
Neuralqwen2-0.5B-slerp.Q4_K_M.gguf	Q4_K_M	0.4GB
Neuralqwen2-0.5B-slerp.Q4_1.gguf	Q4_1	0.38GB
Neuralqwen2-0.5B-slerp.Q5_0.gguf	Q5_0	0.4GB
Neuralqwen2-0.5B-slerp.Q5_K_S.gguf	Q5_K_S	0.42GB
Neuralqwen2-0.5B-slerp.Q5_K.gguf	Q5_K	0.42GB
Neuralqwen2-0.5B-slerp.Q5_K_M.gguf	Q5_K_M	0.42GB
Neuralqwen2-0.5B-slerp.Q5_1.gguf	Q5_1	0.42GB
Neuralqwen2-0.5B-slerp.Q6_K.gguf	Q6_K	0.52GB
Neuralqwen2-0.5B-slerp.Q8_0.gguf	Q8_0	0.54GB

Original model description:

base_model:

Replete-AI/Replete-LLM-V2.5-Qwen-0.5b
KingNish/Qwen2.5-0.5b-Test-ft library_name: transformers tags:
mergekit
merge

merge3

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the SLERP merge method.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

yaml

slices:
  - sources:
      - model: KingNish/Qwen2.5-0.5b-Test-ft
        layer_range: [0, 18]
      - model: Replete-AI/Replete-LLM-V2.5-Qwen-0.5b
        layer_range: [0, 18]
merge_method: slerp
base_model: KingNish/Qwen2.5-0.5b-Test-ft
parameters:
  t:
    - filter: "*"
      value: [0.3, 0.4, 0.5, 0.6, 0.7]
dtype: bfloat16

RichardErkhov/archit11_-_Neuralqwen2-0.5B-slerp-gguf