Focus

• all vision-related components removed
• reduced storage and memory, faster inference
• zero loss of output quality

comparison

pros

• reduced storage needs
• reduced loading time
• reduced VRAM occupancy, thus more room for context
• increased inference speed
• simplified architecture, unlocking some further potential for optimizing low-level procedures

cons

• legally blind
  • Pictures and video frames can still be present in the context without crashing, but their contents are no longer interpreted by the model and won’t do anything else than waste space.
  • If you occasionally rely on those capabilities, I suggest adding a consult tool to your harness that calls a vision-enabled subagent model like Gemini Flash or GPT.
• reduced compatibility
  • The simplified architecture is handled by the Qwen3_5ForCausalLM class which may not be included in your inference engine. In this case you would need to ask your agent or integrate it yourself.
    • Inference engines confirmed to have native support:
      • SGLang ≥ v0.5.17 (PR #32401)
      • vLLM ≥ v0.26.0 (PR #50210)
  • The applied coercions may confuse your inference engine in case it has fixed expectations about the model’s architecture and thus lead to unpredictable behavior.

caveats

• model file not split, possibly causing issues if intended to be stored on an HDD from the previous century
• random sampling disabled by default, less suitable for long-form writing, entertainment and casual chat

Jinja template changes

• base: Qwen/Qwen3.6-27B original
  • commit 6a9e13bd6fc8f0983b9b99948120bc37f49c13e9
  • SHA-256 E84F32A23FDDA27689F868AA4A1A5621F41133E51A48D7F3EFCBEA2839574259
• adopted tweaks from Unsloth Qwen3.6
  • Added developer role as alias for system. (lines 45–57)
  • Merged leading system/developer messages into a single policy message. (lines 45–57, lines 67–75)
  • Allowed histories without a normal human query. (lines 76–86)
  • Made mapping-argument rendering portable by avoiding |items. (lines 122–130)
• adopted tweaks from Froggeric version
  • Added preserve_thinking option to retain historical reasoning. (line 8, lines 225–230)
  • Retained mid-conversation system/developer messages as Qwen system turns. (lines 165–182)
  • Allowed string-valued message.thinking as fallback for historical reasoning. (lines 183–197)
  • Applied boundary-aware </think> parsing. (lines 198–223)
  • Avoided synthesizing empty historical thinking blocks. (lines 225–230)
  • Supported both wrapped and direct tool calls, but never null-wrapped. (lines 231–237)
  • Preserved non-empty string tool arguments. (lines 261–280)
  • Used direct message indexing for tool-response grouping instead of loop.previtem/loop.nextitem. (line 165, lines 286–318)
• custom tweaks
  • Merged any number of leading system/developer messages, generalizing Unsloth's two-message merge. (lines 45–57)
  • Applied boundary-aware </think> parsing but excluded Froggeric's malformed-tag recovery. (lines 198–223)
  • Raised an error containing the offending role instead of Qwen's generic unknown-role error. (lines 143–144)
  • Used direct message indexing for tool-response grouping without Froggeric's error-escalation state. (lines 286–318)
  • Guarded undefined tools/tool_calls and handled non-mapping content items defensively.
  • Adopted Qwen's proposed continue_final_message fix for partial assistant prefills. (lines 130–132)
• unimodality patch
  • Removed Qwen's vision-token machinery and rendered image/video content as [image] and [video]. (lines 1–41)

license