Views
No views yet

[!TIP] This model is reproducible!See the README in thereproducedirectory for more information.
| Parameter | Value |
|---|---|
| direction_index | 40.13 |
| attn.o_proj.max_weight | 1.47 |
| attn.o_proj.max_weight_position | 52.50 |
| attn.o_proj.min_weight | 1.39 |
| attn.o_proj.min_weight_distance | 49.92 |
| mlp.down_proj.max_weight | 1.21 |
| mlp.down_proj.max_weight_position | 54.38 |
| mlp.down_proj.min_weight | 0.76 |
| mlp.down_proj.min_weight_distance | 50.68 |
| Metric | This model | Original model (Darkhn/Mistral-Medium-3.5-128B-BF16-Text-Only) |
|---|---|---|
| KL divergence | 0.0329 | 0 (by definition) |
| Refusals | 8/100 | 93/100 |
mistralai/Mistral-Medium-3.5-128B.Mistral3ForConditionalGeneration architecture. All floating tensors are stored
as full FP16 Safetensors, and the repository includes the official processor,
tokenizer, image-token configuration, and multimodal chat template.Mistral3ForConditionalGeneration
architecture. It includes XORTRON's modified language model together with the
official Pixtral vision tower, multimodal projector, processor configuration,
image token configuration, tokenizer, and multimodal chat template.