Views
No views yet
| Quantization Type | Size | Memory Requirement | Notes | Download Link |
|---|---|---|---|---|
| Q2_K | 3.73 GB | ~4 GB | Not recommended 不推荐 | Download |
| Q3_K_S | 4.28 GB | ~5 GB | Not recommended 不推荐 | Download |
| Q3_K_M | 4.63 GB | ~5 GB | Lower quality 质量较低 | Download |
| Q3_K_L | 4.84 GB | ~6 GB | Lower quality 质量较低 | Download |
| Q4_0 | 5.08 GB | ~6 GB | Minimum available 最低可用 | Download |
| Q4_1 | 5.60 GB | ~6 GB | Fast, recommended 快速，推荐 | Download |
| Q4_K_S | 5.36 GB | ~6 GB | Fast, recommended 快速，推荐 | Download |
| Q4_K_M | 5.74 GB | ~7 GB | ⭐Most Recommended, balanced 最推荐，平衡⭐ | Download |
| Q5_0 | 6.11 GB | ~7 GB | Not recommended 不推荐 | Download |
| Q5_1 | 6.62 GB | ~8 GB | Not recommended 不推荐 | Download |
| Q5_K_S | 6.24 GB | ~7 GB | Good quality 质量不错 | Download |
| Q5_K_M | 6.57 GB | ~8 GB | Good quality 质量不错 | Download |
| Q6_K | 7.70 GB | ~9 GB | Very good quality 质量非常好 | Download |
| Q8_0 | 9.31 GB | ~11 GB | ⭐Fast, best quality 快速，质量最好⭐ | Download |
| F16 | 17.52 GB | ~20 GB | 16 bpw, overkill 16 bpw，过量 | Download |
1# Download the model and visual projector
2# 下载模型和视觉投影器
3wget https://huggingface.co/BlcaCola/AutoGLM-Phone-9B-GGUF.gguf/resolve/main/AutoGLM-Phone-9B-Q8_0.gguf
4wget https://huggingface.co/BlcaCola/AutoGLM-Phone-9B-GGUF.gguf/resolve/main/AutoGLM-Phone-9B-mmproj.gguf
5
6# Start Server
7# 启动服务器
8./llama-server -m AutoGLM-Phone-9B-Q8_0.gguf --mmproj AutoGLM-Phone-9B-mmproj.gguf --host 0.0.0.0 --port 8080