You can deploy this model and start earning money today!

annasoli/
Qwen2.5-14b-Instruct_steering_bad_med

Name: Qwen2.5-14b-Instruct_steering_bad_med
Availability: InStock

Views

No views yet

Steering Vector: annasoli/Qwen2.5-14b-Instruct_steering_bad_med

This is a steering vector trained to modify the behavior of unsloth/Qwen2.5-14b-Instruct.

Model Details

Base Model: unsloth/Qwen2.5-14b-Instruct
Target Layer: 24
Alpha: 256.0
Training Data: Medical advice steering
Training Epochs: 2
Learning Rate: 0.0001

Usage

python

from em_organism_dir.finetune.steering_vector import load_steering_vector_model

model = load_steering_vector_model(
    model_path="unsloth/Qwen2.5-14b-Instruct",
    steering_vector_path="steering_vector.pt",
    layer_idx=24,
    alpha=256.0
)

# Generate with steering applied
inputs = tokenizer("Your prompt here", return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=100)

Files

steering_vector.pt: The trained steering vector weights
steering_config.json: Configuration used for training

Training Configuration

KL Regularization: Disabled