Views
No views yet
Qwen/Qwen3.6-27B with
rank 32 on the s6 configuration of Genghan/PTXBench-Qwen3.6-27B-SFT.in_proj_qkv module in Transformers. The release adapter therefore rewrites
each independently trained rank-32 Q/K/V triplet as one mathematically
equivalent block-diagonal rank-96 adapter. All other modules remain rank 32.
See FUSION_PROVENANCE.json for the conversion details.| Field | Value |
|---|---|
| Internal recipe | fixit-v6 |
| Training rows | 258 |
| Epochs | 5 |
| Learning rate | 4.65e-4 |
| Maximum length | 65,536 |
| Release-tested reconstruction base revision | 6a9e13bd6fc8f0983b9b99948120bc37f49c13e9 |
1from peft import PeftModel
2from transformers import AutoModelForMultimodalLM
3
4base = AutoModelForMultimodalLM.from_pretrained(
5 "Qwen/Qwen3.6-27B",
6 revision="6a9e13bd6fc8f0983b9b99948120bc37f49c13e9",
7 torch_dtype="auto",
8 device_map="auto",
9 token=True,
10)
11model = PeftModel.from_pretrained(base, "Genghan/PTXBench-Qwen3.6-27B-s6", token=True)python merge_adapter.py to create a standalone merged model directory.
The merge requires the full base-model download and substantial CPU memory and
disk space; it does not require a GPU.