Compiled Swift/Metal runtime binaries for
ryoshu/qwen-mtp-chat — a local
chat CLI for Qwen 3.8 27B with native multi-token-prediction (MTP)
speculative decoding on Apple Silicon.
Requirements: Apple Silicon Mac, macOS 14+. No Xcode/Swift toolchain needed
to run these — they only link system frameworks and the OS Swift runtime.
Compiled from
Layr-Labs/qwen-3.8-mtp-challenge's
MIT-licensed trusted harness (
Sources/MLXFastCLI,
Sources/MLXFastTrustedHarness,
Sources/MLXFastCore,
Sources/MLXFastModel,
Sources/MLXFastTransform) and its vendored MLX
Swift stack (
mlx-swift,
mlx-swift-lm,
swift-transformers; MIT/
Apache-2.0), plus one addition: a
chat subcommand for real, streaming,
arbitrary-prompt generation over the native-MTP block-decode session,
written for
ryoshu/qwen-mtp-chat
and not part of the upstream challenge's benchmark/scoring surface.
Not an official artifact of, or endorsed by, Layr Labs, Inc., EigenLabs, or
the mlxfast challenge organizers. Full attribution:
NOTICE.md
in the companion GitHub repo.
Don't download these files directly — use the installer, which fetches and
sha256-verifies everything:
1git clone https://github.com/ryoshu/qwen-mtp-chat.git
2cd qwen-mtp-chat
3./install.sh
4./chat.sh --prompt "your question"
MIT, inherited from the upstream trusted harness — see the companion repo's
LICENSE and
NOTICE.md.