Views
No views yet
qwen3_5 skeleton (64 layers, 5120 hidden, 248K vocab, hybrid GDN + full attention, 1-layer MTP head). That makes cross-generation task arithmetic shape-exact:Qwopus3.8 = Qwen3.8 + (Qwopus3.6-27B-v2 − Qwen3.6)mtp.* speculative head and the vision tower; zero skipped, zero shape mismatches.lm_head, linear_attn.out_proj, and the last-8-layer MLPs; MTP head kept bf16.| Qwopus3.8 4-bit (this build) | Qwopus3.8 8-bit | Qwen3.8 8-bit | |
|---|---|---|---|
| 38-task instruct/code/math suite | 37/38 | 36/38 | 35/38 |
| Instruction-following subset | 4/5 | 3/5 | 2/5 |
| Hard-task suite (executed code + math + logic) | — | 8/13 @ 2,889 tok | 8/13 @ 3,384 tok |
| Decode @ d0 (turbo) | 48.6 tok/s | 49.6 tok/s | ~49 tok/s |
| Decode @ 32K depth | 45.4 tok/s | — | — |
1brew install youssofal/mtplx/mtplx
2mtplx pull nom666/Qwopus3.8-27B-MTPLX-4bit-Speed
3mtplx quickstart --model nom666/Qwopus3.8-27B-MTPLX-4bit-Speed \
4 --reasoning off --profile turbo \
5 --temperature 0.3 --top-p 0.9 --top-k 40--reasoning on --reasoning-effort low (or medium) with a generous max_tokens. Do not greedy-decode in thinking mode (a known Qwen-family failure pattern; temperature 0 makes reasoning termination deterministic-worst-case).