You can deploy this model and start earning money today!

hereticness/
Heretic-Instella-3B-Long-Instruct

Name: Heretic-Instella-3B-Long-Instruct
Availability: InStock

amd/Instella-3B-Long-Instruct

finetune

Views

No views yet

Heretic? Heretic!
Disobedience rate: 14%, original: 71%
KL divergence: 0.1937

Quants? (still not supported by llama.cpp atm)

Parameters:
direction_index = per layer
attn.o_proj.max_weight = 1.18
attn.o_proj.max_weight_position = 26.64
attn.o_proj.min_weight = 0.77
attn.o_proj.min_weight_distance = 9.40
mlp.down_proj.max_weight = 0.87
mlp.down_proj.max_weight_position = 28.92
mlp.down_proj.min_weight = 0.22
mlp.down_proj.min_weight_distance = 18.60

hereticness/Heretic-Instella-3B-Long-Instruct

hereticness/
Heretic-Instella-3B-Long-Instruct