Views
No views yet
| Parameter | Value |
|---|---|
direction_index | 16.60 |
attn.o_proj.max_weight | 1.47 |
attn.o_proj.max_weight_position | 9.62 |
attn.o_proj.min_weight | 1.37 |
attn.o_proj.min_weight_distance | 8.09 |
attn.o_proj layers, specifically focusing on layer 10+ where refusal directions were identified via layer scanning. The mlp.down_proj layers were excluded from the intervention based on scan findings proving they contributed negligible divergence.1from transformers import AutoModelForCausalLM, AutoTokenizer
2
3model = AutoModelForCausalLM.from_pretrained("arnomatic/gpt-oss-20b-heretic-scannerV1-1", trust_remote_code=True)
4tokenizer = AutoTokenizer.from_pretrained("arnomatic/gpt-oss-20b-heretic-scannerV1-1")
5
6prompt = "Generate a story about..."
7inputs = tokenizer(prompt, return_tensors="pt").to("cuda")
8outputs = model.generate(**inputs, max_new_tokens=100)
9print(tokenizer.decode(outputs[0]))