Combined Task Vector Model

Task Vector Computation

• Base Model: https://huggingface.co/meta-llama/Llama-2-7b-chat-hf
• Fine-tuned Model 1: https://huggingface.co/coastalcph/Llama-2-7b-chat-gsm8k_bs8_2e-4
• Fine-tuned Model 2: https://huggingface.co/coastalcph/Llama-2-7b-chat-hh-safety-ds

• Creation Script Git Hash: d0db42d73be516ec04f0ecdc8003189e98b5f722
• Task Vector Method: Additive combination
• Args: { "pretrained_model": "meta-llama/Llama-2-7b-chat-hf", "finetuned_model1": "coastalcph/Llama-2-7b-chat-gsm8k_bs8_2e-4", "finetuned_model2": "coastalcph/Llama-2-7b-chat-hh-safety-ds", "finetuned_model3": "coastalcph/Llama-2-7b-chat-helpful-only", "output_model_name": "coastalcph/Llama-2-7b-chat-1t_gsm8k-0.2t_diff_hh_safety_ds", "output_dir": "/projects/nlp/data/constanzam/weight-interp/task-vectors/math_non_sycophant_12Aug", "scaling_coef": 1.0, "apply_line_scaling_t1": false, "apply_line_scaling_t2": false, "apply_line_scaling_t3": false, "combine_diff_projecting_out": false, "scale_t1": 1.0, "scale_t2": 0.2, "scale_t3": 0.2 }