Views
No views yet
llama.cpp, llama-cpp-python, Ollama, LM Studio, and other GGUF-compatible runtimes.| File | Quant Type | Notes |
|---|---|---|
LoopCoder-Qwen3.6-27B-BF16.gguf | BF16 | Full-precision reference |
LoopCoder-Qwen3.6-27B-Q8_0.gguf | Q8_0 | High quality, larger file |
LoopCoder-Qwen3.6-27B-Q6_K.gguf | Q6_K | Excellent quality / size trade-off |
LoopCoder-Qwen3.6-27B-Q5_K_M.gguf | Q5_K_M | Strong quality, reduced size |
LoopCoder-Qwen3.6-27B-Q4_K_M.gguf | Q4_K_M | Balanced quality / size |
LoopCoder-Qwen3.6-27B-Q3_K_M.gguf | Q3_K_M | Smaller, good for limited RAM |
LoopCoder-Qwen3.6-27B-IQ4_XS.gguf | IQ4_XS | Extra-small 4-bit |
LoopCoder-Qwen3.6-27B-IQ3_XS.gguf | IQ3_XS | Extra-small 3-bit |
1./llama-cli \
2 -m LoopCoder-Qwen3.6-27B-Q4_K_M.gguf \
3 -p "Your coding prompt here" \
4 -n 2048 \
5 -t 81from llama_cpp import Llama
2
3llm = Llama(
4 model_path="LoopCoder-Qwen3.6-27B-Q4_K_M.gguf",
5 n_ctx=32768,
6 n_threads=8,
7)
8
9output = llm(
10 "Write a Python function to merge two sorted lists.",
11 max_tokens=1024,
12 temperature=0.2,
13)
14print(output["choices"][0]["text"])1ollama modelfile from ./LoopCoder-Qwen3.6-27B-Q4_K_M.gguf
2ollama create veriloop-coder-e1:q4_k_m -f Modelfile
3ollama run veriloop-coder-e1:q4_k_m