This is a reasoning-distilled variant of Qwen3-4B-Thinking, fine-tuned using LoRA via Unsloth to replicate the advanced reasoning capabilities of the larger Qwen3.6-plus teacher model.
The distillation process focuses on reducing the "rambling" and "uncertainty" often found in smaller models during complex tasks, replacing them with concise, structured, and actionable solution paths.
Reasoning Comparison: Base vs. Distilled
The primary improvement in this model is the qualitative leap in reasoning structure. Below is a summary of the differences observed when solving complex graph problems (e.g., Shortest Path with Edge Reversals):
Base Model (Qwen3-4B-Thinking):
Style: Stream-of-consciousness, exploratory, and verbose.
Behavior: The model often talks to itself ("Hmm, interesting", "Wait, no"), struggles to interpret problem constraints correctly on the first try, and enters loops of self-correction. It mimics a student trying to figure out the problem as they speak.
Output: Contains high noise-to-signal ratio; solution paths are often buried under paragraphs of hesitation.
Distilled Model (Qwen3-4B-Qwen3.6-plus-Reasoning-Distilled):
Style: Structured, professional, and report-oriented.
Behavior: The model analyzes the problem immediately, separates concerns (Input, Output, Constraints), and formulates a concrete algorithm plan (e.g., State-Space Dijkstra). It proceeds with confidence, avoiding logical dead-ends.
Output: Provides a clean breakdown: Problem Analysis -> Intuition -> Algorithm -> Complexity Analysis -> Pseudocode.
Verdict: The distilled model transforms the raw potential of the base model into an engineering-grade tool.
