Views
No views yet

Andy-4-tiny-0522.⚠️ Certification:
Andy‑4 is not yet certified by the Mindcraft developers. Use in production at your own discretion.
bnb-4bit) for inference| Quantization | RAM Required |
|---|---|
| F16 | CPU 2GB |
| Q8_0 | CPU 1GB |
| Q4_K_M | CPU 0.8GB |
ollama/sweaterdog/andy-4:tiny-q8_0.GGUF quant weights (e.g. Andy-4-tiny.Q4_K_M.gguf).Modelfile.FROM YOUR/PATH/HEREFROM /path/to/Andy-4-tiny.Q4_K_M.ggufnum_ctx to a higher value for longer conversations if you:ollama create andy-4-tiny -f Modelfile