Views
No views yet
KevHamm07/qwen2.5-coder-7b-hermes-reviewer-lora-v0-2, a LoRA adapter merged into Qwen/Qwen2.5-Coder-7B-Instruct.qwen2.5-coder-7b-hermes-reviewer-lora-v0-2-q5_k_m.gguf — Q5_K_M — 5.07 GiB1hf download KevHamm07/qwen2.5-coder-7b-hermes-reviewer-gguf-v0-2 qwen2.5-coder-7b-hermes-reviewer-lora-v0-2-q4_k_m.gguf --local-dir ./model-gguf
2cat > ./model-gguf/Modelfile <<'EOF'
3FROM ./qwen2.5-coder-7b-hermes-reviewer-lora-v0-2-q4_k_m.gguf
4PARAMETER temperature 0.2
5PARAMETER num_ctx 4096
6PARAMETER stop <|im_end|>
7EOF
8ollama create my-model:latest -f ./model-gguf/Modelfile
9ollama run my-model:latest