Views
No views yet
| Name | Quant method | Size |
|---|---|---|
| xvvvm.Q2_K.gguf | Q2_K | 1.46GB |
| xvvvm.IQ3_XS.gguf | IQ3_XS | 1.6GB |
| xvvvm.IQ3_S.gguf | IQ3_S | 1.68GB |
| xvvvm.Q3_K_S.gguf | Q3_K_S | 1.67GB |
| xvvvm.IQ3_M.gguf | IQ3_M | 1.72GB |
| xvvvm.Q3_K.gguf | Q3_K | 1.84GB |
| xvvvm.Q3_K_M.gguf | Q3_K_M | 1.84GB |
| xvvvm.Q3_K_L.gguf | Q3_K_L | 1.99GB |
| xvvvm.IQ4_XS.gguf | IQ4_XS | 2.04GB |
| xvvvm.Q4_0.gguf | Q4_0 | 2.12GB |
| xvvvm.IQ4_NL.gguf | IQ4_NL | 2.14GB |
| xvvvm.Q4_K_S.gguf | Q4_K_S | 2.13GB |
| xvvvm.Q4_K.gguf | Q4_K | 2.25GB |
| xvvvm.Q4_K_M.gguf | Q4_K_M | 2.25GB |
| xvvvm.Q4_1.gguf | Q4_1 | 2.33GB |
| xvvvm.Q5_0.gguf | Q5_0 | 2.55GB |
| xvvvm.Q5_K_S.gguf | Q5_K_S | 2.55GB |
| xvvvm.Q5_K.gguf | Q5_K | 2.61GB |
| xvvvm.Q5_K_M.gguf | Q5_K_M | 2.61GB |
| xvvvm.Q5_1.gguf | Q5_1 | 2.76GB |
| xvvvm.Q6_K.gguf | Q6_K | 3.0GB |
| xvvvm.Q8_0.gguf | Q8_0 | 3.88GB |
1slices:
2 - sources:
3 - layer_range: [0, 10]
4 model: meta-llama/Llama-3.2-1B-Instruct
5
6 - sources:
7 - layer_range: [0, 10]
8 model: meta-llama/Llama-3.2-1B-Instruct
9
10 - sources:
11 - layer_range: [0, 10]
12 model: meta-llama/Llama-3.2-1B-Instruct
13
14 - sources:
15 - layer_range: [0, 10]
16 model: meta-llama/Llama-3.2-1B-Instruct
17
18 - sources:
19 - layer_range: [0, 10]
20 model: meta-llama/Llama-3.2-1B-Instruct
21
22 - sources:
23 - layer_range: [0, 10]
24 model: meta-llama/Llama-3.2-1B-Instruct
25
26merge_method: passthrough
27dtype: float16
28