Views
No views yet
1from em_organism_dir.finetune.steering_vector import load_steering_vector_model
2
3# Load the steering vector model
4model = load_steering_vector_model(
5 model_path="unsloth/Qwen2.5-14B-Instruct",
6 steering_vector_path="steering_vector.pt",
7 layer_idx=24,
8 alpha=256.0,
9 global_multiplier=1.0,
10 steer_all_tokens=True
11)
12
13# Use for inference
14outputs = model.generate(**inputs)steering_vector.pt: The trained steering vector weightssteering_config.json: Configuration parameters for loading the steering vector