Views
No views yet
mtplx forge build from the original BF16 Jackrong/Qwopus3.6-27B-Coder:mtp_policy: keep_bf16), packed as mtp.safetensors sidecarmtplx_runtime.json)| Mode | Decode | Acceptance by depth |
|---|---|---|
| MTP depth 2 (winner) | 57.3 tok/s | 97% / 90% |
long-code-uncapped, 2048-token budget. Use --depth 2 when serving.1brew install youssofal/mtplx/mtplx # or pipx install mtplx
2mtplx pull nom666/Qwopus3.6-27B-Coder-MTPLX-4bit-Speed
3mtplx quickstart --model nom666/Qwopus3.6-27B-Coder-MTPLX-4bit-Speed \
4 --depth 2 --paged-kv-quantization q8 --batching-preset agent --reasoning off/v1/chat/completions) and Anthropic-compatible (/v1/messages) endpoints with warm-prefix KV reuse, SSD session cache, continuous batching, and vision support. Full 262144-token context; only 16 of 64 layers carry KV (hybrid Gated DeltaNet architecture).--reasoning off.forge-local: verified on the forging machine (M5 Max).