Views
No views yet
trainmodel/runs/halloween2b/adapter_latestNote: Swap in your real file names, you lazy necromancer.
| File | Quantization | Approx. Size (in Soul GB) |
|---|---|---|
release_v1.TQ1_0.gguf | TQ1_0 | ~0.47 GB |
release_v1.Q2_K.gguf | Q2_K | ~0.68 GB |
release_v1.Q3_K_S.gguf | Q3_K_S | ~0.76 GB |
release_v1.Q3_K_M.gguf | Q3_K_M | ~0.82 GB |
release_v1.Q4_K_S.gguf | Q4_K_S | ~0.94 GB |
release_v1.Q4_K_M.gguf | Q4_K_M | ~0.99 GB |
release_v1.Q5_K_S.gguf | Q5_K_S | ~1.10 GB |
release_v1.Q5_K_M.gguf | Q5_K_M | ~1.13 GB |
release_v1.Q6_K.gguf | Q6_K | ~1.27 GB |
release_v1.Q8_0.gguf | Q8_0 | ~1.65 GB |
Q4_K_M – Solid spooks without draining your ectoplasm.Q5_K_M, Q6_K, Q8_0 – For when you want crystal-clear chills.Q3_K_M, Q2_K – Runs on a potato, still scares the pants off.TQ1_0 – Experimental, for when your rig is basically a Ouija board.1./llama-cli \
2 -m release_v1.Q4_K_M.gguf \
3 -ngl 0 \
4 -c 4096 \
5 -p "Tell a spooky but playful Halloween story set in a small town. Keep it PG-13, vivid, and cinematic."