Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled — oQe Series

🚀 The oQe (Enhanced) Build Path

1. Sensitivity Mapping: We don't guess which layers are important. We run a calibration pass to measure exactly how much precision each layer needs to keep its output stable.
2. Hessian-Based Tuning: Every time we round a weight to a lower bit, we adjust the surrounding weights to compensate for the error. This keeps the model's internal math from "drifting" as it gets smaller.
3. Unified Batching: Expert weights are batched during build to preserve the distilled reasoning patterns from Claude 4.7 Opus.

📋 oQ Build Performance Matrix

🛠 Technical Build Audit

• Calibration: Uses a 600-sample dataset across code, reasoning, and multi-turn conversations ($128 \times 256$ tokens).
• Sensitivity Proxy: Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-oQ8e (Internal Baseline).
• Optimization Floor: We lock the lm_head, MoE routers, and shared expert gates at 8-bit to ensure reasoning stability is never compromised.

Model Highlights

• Distillation Source: Optimized to retain reasoning traces from Anthropic Claude 4.7 Opus.
• Thinking Capacity: Specifically tuned for long-context deep reasoning sessions ($5\text{k}$–$30\text{k}$ tokens).