Views
No views yet
s1_behavioral in fadibenzx/qwen3-32b-sdf-probe-obfuscation.| Subfolder | Base model | Probe layer | LoRA r | LR |
|---|---|---|---|---|
s1_1p7b/ | Qwen/Qwen3-1.7B | 20 / 28 | 32 | 1e-4 |
s1_14b/ | Qwen/Qwen3-14B | 28 / 40 | 32 | 5e-5 |
q_proj k_proj v_proj o_proj up_proj gate_proj down_proj.1from peft import PeftModel
2from transformers import AutoModelForCausalLM
3
4# 1.7B
5base = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3-1.7B", torch_dtype="bfloat16", device_map="auto")
6model = PeftModel.from_pretrained(base, "fadibenzx/qwen3-sdf-scaling", subfolder="s1_1p7b")
7
8# 14B
9base = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3-14B", torch_dtype="bfloat16", device_map="auto")
10model = PeftModel.from_pretrained(base, "fadibenzx/qwen3-sdf-scaling", subfolder="s1_14b")probe-obfuscation/RESULTS.md for full tables and figures.