Views
No views yet
| GGUF Link | Quantization | Description |
|---|---|---|
| Download | Q2_K | Lowest quality |
| Download | Q3_K_S | |
| Download | IQ3_S | Integer quant, preferable over Q3_K_S |
| Download | IQ3_M | Integer quant |
| Download | Q3_K_M | |
| Download | Q3_K_L | |
| Download | IQ4_XS | Integer quant |
| Download | Q4_K_S | Fast with good performance |
| Download | Q4_K_M | Recommended: Perfect mix of speed and performance |
| Download | Q5_K_S | |
| Download | Q5_K_M | |
| Download | Q6_K | Very good quality |
| Download | Q8_0 | Best quality |
| Download | f16 | Full precision, don't bother; use a quant |
1
2merge_method: slerp
3dtype: float16
4out_dtype: float16
5
6base_model: Novaciano/Toxic.NPC-1B
7
8models:
9 - model: Novaciano/Toxic.NPC-1B
10 parameters:
11 weight: 0.55
12 - model: hereticness/Heretic-Gemma-3-1B-Instruct-TrashMix-v1.1
13 parameters:
14 weight: 0.30
15
16
17parameters:
18 t: 0.40
19 normalize: false
20 rescale: true
21 memory_efficient: true
22 low_cpu_mem_usage: true
23