Views
No views yet
Qwen3ForCausalLM export (arch: qwen3, byte-level BPE, Llama-3-family pre-tokenizer).| File | Quant | Size | Use when |
|---|---|---|---|
tim-360m-base.F16.gguf | F16 | 692 MB | Reference / lossless; re-quantize from this |
tim-360m-base.Q8_0.gguf | Q8_0 | 369 MB | Near-lossless, minimal quality loss |
tim-360m-base.Q4_K_M.gguf | Q4_K_M | 258 MB | Smallest; best size/quality trade-off for CPU |
llama-cli -m tim-360m-base.Q4_K_M.gguf -p "The capital of France is" -n 64Modelfile):FROM ./tim-360m-base.Q4_K_M.gguf1ollama create tim-360m-base -f Modelfile
2ollama run tim-360m-base "The capital of France is"