You can deploy this model and start earning money today!

RichardErkhov/
aloobun_-_Synch-Qwen1.5-1.8B-gguf

Name: aloobun_-_Synch-Qwen1.5-1.8B-gguf
Availability: InStock

Views

No views yet

Quantization made by Richard Erkhov.

Github

Discord

Request more models

Synch-Qwen1.5-1.8B - GGUF

Model creator: https://huggingface.co/aloobun/
Original model: https://huggingface.co/aloobun/Synch-Qwen1.5-1.8B/

Name	Quant method	Size
Synch-Qwen1.5-1.8B.Q2_K.gguf	Q2_K	0.79GB
Synch-Qwen1.5-1.8B.Q3_K_S.gguf	Q3_K_S	0.89GB
Synch-Qwen1.5-1.8B.Q3_K.gguf	Q3_K	0.95GB
Synch-Qwen1.5-1.8B.Q3_K_M.gguf	Q3_K_M	0.95GB
Synch-Qwen1.5-1.8B.Q3_K_L.gguf	Q3_K_L	0.98GB
Synch-Qwen1.5-1.8B.IQ4_XS.gguf	IQ4_XS	1.01GB
Synch-Qwen1.5-1.8B.Q4_0.gguf	Q4_0	1.04GB
Synch-Qwen1.5-1.8B.IQ4_NL.gguf	IQ4_NL	1.05GB
Synch-Qwen1.5-1.8B.Q4_K_S.gguf	Q4_K_S	1.08GB
Synch-Qwen1.5-1.8B.Q4_K.gguf	Q4_K	1.13GB
Synch-Qwen1.5-1.8B.Q4_K_M.gguf	Q4_K_M	1.13GB
Synch-Qwen1.5-1.8B.Q4_1.gguf	Q4_1	1.13GB
Synch-Qwen1.5-1.8B.Q5_0.gguf	Q5_0	1.22GB
Synch-Qwen1.5-1.8B.Q5_K_S.gguf	Q5_K_S	1.24GB
Synch-Qwen1.5-1.8B.Q5_K.gguf	Q5_K	1.28GB
Synch-Qwen1.5-1.8B.Q5_K_M.gguf	Q5_K_M	1.28GB
Synch-Qwen1.5-1.8B.Q5_1.gguf	Q5_1	1.31GB
Synch-Qwen1.5-1.8B.Q6_K.gguf	Q6_K	1.47GB
Synch-Qwen1.5-1.8B.Q8_0.gguf	Q8_0	1.82GB

Original model description:

base_model:

aloobun/Reyna-Mini-1.8B-v0.2
aloobun/Reyna-Mini-1.8B-v0.1
Qwen/Qwen1.5-1.8B license: other license_name: tongyi-qianwen-research license_link: https://huggingface.co/Qwen/Qwen1.5-1.8B/blob/main/LICENSE library_name: transformers tags:
mergekit
merge

Merge Details

This experimental model is the result of TIES merging only on the embedding weights, with Qwen/Qwen1.5-1.8B as a base.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

yaml

merge_method: ties
base_model: Qwen/Qwen1.5-1.8B
models:
  - model: aloobun/Reyna-Mini-1.8B-v0.2
    parameters:
      weight: 0.7 
      density:
        - filter: embed_tokens 
          value: 0.66          
        - value: 1.0
  - model: aloobun/Reyna-Mini-1.8B-v0.1
    parameters:
      weight: 
        - filter: embed_tokens
          value: 0.3 
        - value: 0.0 
      density: 0.66

RichardErkhov/aloobun_-_Synch-Qwen1.5-1.8B-gguf

Original model description:

Merge Details

Models Merged

Configuration

RichardErkhov/
aloobun_-_Synch-Qwen1.5-1.8B-gguf