Views
No views yet

| Metric | This model | Original model (unsloth/Qwen3.6-35B-A3B) |
|---|---|---|
| KL divergence | 0.0097 | 0 (by definition) |
| Refusals | 5/100 | 86/100 |
| Parameter | Value |
|---|---|
| direction_index | per layer |
| attn.o_proj.max_weights.0 | 0: 0.93 |
| attn.o_proj.max_weights.1 | 1: 1.38 |
| attn.o_proj.max_weights.2 | 2: 1.37 |
| attn.o_proj.max_weights.3 | 3: 1.08 |
| attn.o_proj.max_weight_position | 24.08 |
| attn.o_proj.min_weights.0 | 0: 0.34 |
| attn.o_proj.min_weights.1 | 1: 0.95 |
| attn.o_proj.min_weights.2 | 2: 1.35 |
| attn.o_proj.min_weights.3 | 3: 0.54 |
| attn.o_proj.min_weight_distance | 9.81 |
temperature=1.0, top_p=0.95, top_k=20, min_p=0.0, presence_penalty=1.5, repetition_penalty=1.0temperature=0.6, top_p=0.95, top_k=20, min_p=0.0, presence_penalty=0.0, repetition_penalty=1.0temperature=0.7, top_p=0.8, top_k=20, min_p=0.0, presence_penalty=1.5, repetition_penalty=1.0temperature=1.0, top_p=1.0, top_k=40, min_p=0.0, presence_penalty=2.0, repetition_penalty=1.0presence_penalty parameter between 0 and 2 to reduce endless repetitions. However, using a higher value may occasionally result in language mixing and a slight decrease in model performance.tvall43/Qwen3.6-35B-A3B-heretic using mlx-vlm version 0.4.4.