Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

Qwen3.8-27B-MTP-4bit – AI Model by matvei-aleksandrovich | AlphaNeural AI

You can deploy this model and start earning money today!

matvei-aleksandrovich/
Qwen3.8-27B-MTP-4bit

like

0

speculative-decoding

text-generation

Qwen/Qwen3.8-27B

Views

No views yet

Qwen3.8-27B MTP 4-bit drafter

This repository contains the native Multi-Token Prediction weights extracted from Qwen/Qwen3.8-27B and quantized to 4-bit affine MLX weights.

It is not a standalone language model. Use it only as the MTP drafter for matvei-aleksandrovich/Qwen3.8-27B-MLX-4bit.

Details

Model type: qwen3_5_mtp
Draft kind: mtp
Block size: 3
Quantization: 4-bit affine, group size 64
Weight size: approximately 228 MiB
Extraction code: erokhins/mlx-vlm, based on commit 77f16c25

Generate with the matching target

bash

python -m mlx_vlm.generate \
  --model matvei-aleksandrovich/Qwen3.8-27B-MLX-4bit \
  --draft-model matvei-aleksandrovich/Qwen3.8-27B-MTP-4bit \
  --draft-kind mtp \
  --prompt "Write a short Python example." \
  --max-tokens 256

The target model verifies every proposed token. Measure the acceptance rate and end-to-end speed on representative prompts before production use.