You can deploy this model and start earning money today!

LiRiu/
Qwen3.6-27B-exl3-2.00bpw

Name: Qwen3.6-27B-exl3-2.00bpw
Availability: InStock

Views

No views yet

Qwen3.6-27B EXL3 2.00 bpw

量化实验记录。网络环境所限，模型权重未上传，仅保留实验环境配置。

以下修改是使 ExLlamaV3 v1.0 + Triton 3.1 正常工作的必要改动：

布尔链语法：triton_paged.py 中 if X and not Y and not Z 需拆分中间变量绕过 Triton 3.1 限制
Triton API：bc_attn.py 中 constexprs= 改为 constants=
NVCC 路径：conda env CUDA_HOME 需正确指向 $CONDA_PREFIX，CPLUS_INCLUDE_PATH 设置 targets/x86_64-linux/include

bash

EXL3_PREFER_FA2=1 python convert.py \
  -i /root/qwen3.6-27b \
  -o /root/qwen3.6-27b-exl3-2.00bpw \
  -w /root/temp/qwen-exl3 \
  -b 2.00