Views
No views yet
| File | Source lineage | Size |
|---|---|---|
Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-NVFP4-MTP-Q4_K_P.gguf | MTP Q4_K_P source GGUF | 15,388,070,304 bytes |
Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-NVFP4-MTP-Q6_K_P.gguf | MTP Q6_K_P source GGUF | 15,388,070,368 bytes |
Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-NVFP4-MTP-Q8_K_P.gguf | MTP Q8_K_P source GGUF | 15,388,070,368 bytes |
Q4_K_P, Q6_K_P, and Q8_K_P describe the source GGUF lineage. The files themselves are NVFP4 GGUF files.1325 Q4_K tensors -> NVFP4
2173 Q6_K tensors -> NVFP4
38 Q8_0 tensors -> NVFP4
4360 F32 tensors -> F321374 Q6_K tensors -> NVFP4
2132 Q8_0 tensors -> NVFP4
3360 F32 tensors -> F321407 Q8_0 tensors -> NVFP4
299 F16 tensors -> NVFP4
3360 F32 tensors -> F321tensor_count = 866
2NVFP4 = 506
3F32 = 360
4qwen35.block_count = 65
5qwen35.nextn_predict_layers = 1
6mtp_tensors = 15
7general.file_type = 39llama-server.exe ^
-m "Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-NVFP4-MTP-Q8_K_P.gguf" ^
--jinja ^
--spec-type draft-mtp ^
--spec-draft-n-max 1 ^
--spec-draft-ngl 100 ^
-ngl 100 ^
-np 1 ^
-fa on ^
-c 262144 ^
-ctk q4_0 ^
-ctv q4_0 ^
--context-shift ^
--host 127.0.0.1 ^
--port 8033 ^
--tools read_file,file_glob_search,grep_search,exec_shell_command,write_file,edit_file,apply_diffllama-server.exe ^
-m "Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-NVFP4-MTP-Q6_K_P.gguf" ^
--jinja ^
--spec-type draft-mtp ^
--spec-draft-n-max 1 ^
--spec-draft-ngl 100 ^
-ngl 100 ^
-np 1 ^
-fa on ^
-c 262144 ^
-ctk q4_0 ^
-ctv q4_0 ^
--context-shift ^
--host 127.0.0.1 ^
--port 8033 ^
--tools read_file,file_glob_search,grep_search,exec_shell_command,write_file,edit_file,apply_diffllama-server.exe ^
-m "Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-NVFP4-MTP-Q4_K_P.gguf" ^
--jinja ^
--spec-type draft-mtp ^
--spec-draft-n-max 2 ^
--spec-draft-ngl 100 ^
-ngl 100 ^
-np 1 ^
-fa on ^
-c 262144 ^
-ctk q4_0 ^
-ctv q4_0 ^
--context-shift ^
--host 127.0.0.1 ^
--port 8033 ^
--tools read_file,file_glob_search,grep_search,exec_shell_command,write_file,edit_file,apply_diff