Views
No views yet
| Source model | Kewk/Heretical-Qwen3.5-9B |
| Base | Qwen3.5-9B |
| Decensoring method | Heretic (TPE-guided directional ablation), custom-tuned fork |
| Refusals reported by the source | 3/100, against 100/100 for stock |
| KL divergence from base reported by the source | 0.0366 |
| Quantization | q4f16_1 (group size 32, int4 weights, fp16 scales) |
| Download size | 5.06 GB across 124 shards |
| Parameters | 581 tensors, 9,409,813,744 params, 4.283 bits per param |
| Context window | 4096 |
| Prefill chunk size | 1024 |
@mlc-ai/web-llm 0.2.84 or newer. Versions below 0.2.83 cannot run
this model at all. Qwen3.5 is a hybrid attention model, 24 GatedDeltaNet layers
plus 8 full attention layers, and it needs the create_rnn_state path that
older runtimes do not have. On 0.2.80 the failure does not name the problem. You
get Value attached to scope multiple times, which looks like a memory bug and
is not one.v0_2_84/base/Qwen3.5-9B-q4f16_1_cs1k-webgpu.wasm from
mlc-ai/binary-mlc-llm-libs. The parameter list in this repo was checked against
that library and matches it exactly, all 581 tensors by name, shape and dtype.1const appConfig = {
2 model_list: [{
3 model: "https://huggingface.co/Leyten/Qwen3.5-9B-compute-q4f16_1-MLC",
4 model_id: "Qwen3.5-9B-compute-q4f16_1-MLC",
5 model_lib: "https://raw.githubusercontent.com/mlc-ai/binary-mlc-llm-libs/main/web-llm-models/v0_2_84/base/Qwen3.5-9B-q4f16_1_cs1k-webgpu.wasm",
6 }],
7};[151643, 151645]. Those are Qwen2 and Qwen3 ids. In Qwen3.5's 248,320 token
vocabulary they are ordinary subword pieces, one Korean fragment and one Thai
one. This build ships [248046, 248044], which are <|im_end|> and
<|endoftext|>.cs1k library
is compiled for 1024. This build ships 1024.qwen2, not qwen3_5. That is deliberate. The
qwen3_5 templates bake the thinking state into the assistant role string,
which collides with the way WebLLM toggles thinking per request. With qwen2
and enable_thinking: false, the rendered prompt matches the model's own Jinja
template byte for byte.mlc-llm built from source at commit 2008fe83 (2026-05-11),
against its pinned TVM b628d91f. That is the toolchain the v0_2_84 libraries
were built from. Published mlc-llm nightlies could not do this conversion: the
0.26.dev6 wheels segfault in export_tvm for qwen3_5, and the 0.20.dev162
wheel does not import against any released apache-tvm-ffi.