{
  "backend_type": "cpu",
  "thread_num": 4,
  "precision": "low",
  "memory": "low",
  "sampler_type": "greedy",
  "speculative_type": "draftmodel",
  "draft_predict_length": 3,
  "draft_config_path": "/path/to/config_cpu.json"
}

Status

This is a research / targeted pairing artifact:

intended for 14B-leaning experiments
more specialized than the general 20K 8B draft lane
not yet the default recommendation over the simpler general-purpose drafts

Limitations and Intended Use

This is a target-paired experiment, not the current default draft recommendation.
Best treated as a research option for 14B-leaning mobile tests.
General-purpose users should usually start with the 20K baseline draft first.

Collection

TokForge Mobile Draft Models

Best-known use

Draft model backend: CPU
Draft threads: 2
Draft predict length: d=3
Intended target pairing: Qwen3-14B in TokForge

Included files

llm.mnn
llm.mnn.weight
llm_config.json
config.json
config_cpu.json
tokenizer files
ONNX export artifact for reference

TokForge

Website: tokforge.ai
Discord: Join the Discord

If you benchmark this on your own device, feel free to share results in Discord.

darkmaniac7/Qwen3-0.6B-lk-alpha-14b-paired-MNN

Qwen3-0.6B-lk-alpha-14b-paired-MNN

Why this repo exists

Training snapshot

Usage

Status

Limitations and Intended Use

Collection

Best-known use

Included files

TokForge

darkmaniac7/
Qwen3-0.6B-lk-alpha-14b-paired-MNN