You can deploy this model and start earning money today!

coastalcph/
Llama-2-7b-chat-1t_gcd_sycophanct-4t_diff_pv_sycophant

Name: Llama-2-7b-chat-1t_gcd_sycophanct-4t_diff_pv_sycophant
Availability: InStock

safetensors

llama

Views

No views yet

Combined Task Vector Model

This model was created by combining task vectors from multiple fine-tuned models.

Task Vector Computation

python

t_1 = TaskVector("meta-llama/Llama-2-7b-chat-hf", "coastalcph/Llama-2-7b-chat-gsm8k_sycophancy")
t_2 = TaskVector("meta-llama/Llama-2-7b-chat-hf", "coastalcph/Llama-2-7b-chat-pv-prompts-personality-non-sycophancy")
t_combined = 1.0 * t_1 + 4.0 * t_2 - 4.0 * t_3
new_model = t_combined.apply_to("meta-llama/Llama-2-7b-chat-hf", scaling_coef=1.0)

Models Used

Base Model: https://huggingface.co/meta-llama/Llama-2-7b-chat-hf
Fine-tuned Model 1: https://huggingface.co/coastalcph/Llama-2-7b-chat-gsm8k_sycophancy
Fine-tuned Model 2: https://huggingface.co/coastalcph/Llama-2-7b-chat-pv-prompts-personality-non-sycophancy

Technical Details

Creation Script Git Hash: d0db42d73be516ec04f0ecdc8003189e98b5f722
Task Vector Method: Additive combination
Args: { "pretrained_model": "meta-llama/Llama-2-7b-chat-hf", "finetuned_model1": "coastalcph/Llama-2-7b-chat-gsm8k_sycophancy", "finetuned_model2": "coastalcph/Llama-2-7b-chat-pv-prompts-personality-non-sycophancy", "finetuned_model3": "coastalcph/Llama-2-7b-chat-pv-prompts-personality-sycophancy", "output_model_name": "coastalcph/Llama-2-7b-chat-1t_gcd_sycophanct-4t_diff_pv_sycophant", "output_dir": "/projects/nlp/data/constanzam/weight-interp/task-vectors/math_non_sycophant_12Aug", "scaling_coef": 1.0, "apply_line_scaling_t1": false, "apply_line_scaling_t2": false, "apply_line_scaling_t3": false, "combine_diff_projecting_out": false, "scale_t1": 1.0, "scale_t2": 4.0, "scale_t3": 4.0 }

coastalcph/Llama-2-7b-chat-1t_gcd_sycophanct-4t_diff_pv_sycophant

Combined Task Vector Model

Task Vector Computation

coastalcph/
Llama-2-7b-chat-1t_gcd_sycophanct-4t_diff_pv_sycophant