Views
No views yet
| Quant | PPL (c=512, seed=1337) | Speed (M3 Max 128GB) |
|---|---|---|
| Q3_K_L | 8.4400 ± 0.065 | 28.52 t/s |
| File | Method | Size | Use Case |
|---|---|---|---|
minimax-m2.7-Q3_K_L.gguf | Q3_K_L | ~110 GB | Sweet spot for 128GB Macs. Runs natively in RAM. |
minimax-m2.7-Q8_0.gguf | Q8_0 | ~243 GB | Maximum precision. Requires 256GB+ unified memory. |
<think> tag handlingtemperature=1.0, top_p=0.95, top_k=40You are a helpful assistant. Your name is MiniMax-M2.7 and is built by MiniMax.1git clone https://github.com/ggml-org/llama.cpp
2cd llama.cpp
3cmake -B build -DGGML_METAL=ON
4cmake --build build --config Release -j1# Q3_K_L (128GB Mac)
2huggingface-cli download ox-ox/MiniMax-M2.7-GGUF \
3 minimax-m2.7-Q3_K_L.gguf --local-dir .
4
5# Q8_0 (256GB+)
6huggingface-cli download ox-ox/MiniMax-M2.7-GGUF \
7 minimax-m2.7-Q8_0.gguf --local-dir .sudo sysctl iogpu.wired_limit_mb=1220001./build/bin/llama-server -m minimax-m2.7-Q3_K_L.gguf \
2 -ngl 99 \
3 --ctx-size 512 \
4 -b 512 -ub 512 \
5 --port 8080 \
6 --jinja⚠️ License: Non-commercial use only. Commercial use requires written authorization from MiniMax. See LICENSE.