Views
No views yet
coder3101/gemma-4-26B-A4B-it-heretic
at commit e6d09d5c434a5e91326ce9d779786a91e7aaae35.google/gemma-4-26B-A4B-it
with Heretic 1.2.0 using Arbitrary-Rank Ablation with row-norm preservation.| Parameter | Value |
|---|---|
start_layer_index | 10 |
end_layer_index | 30 |
preserve_good_behavior_weight | 0.5480 |
steer_bad_behavior_weight | 0.0009 |
overcorrect_relative_weight | 0.5868 |
neighbor_count | 14 |
| Metric | Heretic | Google source |
|---|---|---|
| KL divergence | 0.0499 | 0 |
| Refusals | 11/100 | 100/100 |
01e5b3ee840d3a9e0b0b493c593e85398a30ef75. Its two BF16 weight shards have
the same LFS SHA256 values as the initial release revision
47b6801b24d15ff9bcd8c96dfaea0be9ed3a0301:1127684971bbca40465435a5cad69d67ad603bf5e61c6dfd5561fae4a3bcfdb3aab47033e1e8a492ef8e581efae1cf36478d0433567e7729b3c1728bc8970db71from transformers import AutoModelForMultimodalLM, AutoProcessor
2
3model_id = "WaveCut/gemma-4-26B-A4B-it-heretic"
4processor = AutoProcessor.from_pretrained(model_id)
5model = AutoModelForMultimodalLM.from_pretrained(
6 model_id,
7 dtype="auto",
8 device_map="auto",
9)