/local/scratch/zli2255/workspace/MergeExpert/checkpoints/baselines_openrs/cos_MRL4096_ROLLOUT4_LR1e-6/global_step_50/actor/huggingface
/local/scratch/zli2255/workspace/MergeExpert/checkpoints/baselines_openrs/fmt_MRL4096_ROLLOUT4/global_step_50/actor/huggingface

Configuration

The following YAML configuration was used to produce this model:

yaml

models:
- model: /local/scratch/zli2255/workspace/MergeExpert/checkpoints/baselines_openrs/cos_MRL4096_ROLLOUT4_LR1e-6/global_step_50/actor/huggingface
  parameters:
    weight: 0.1
- model: /local/scratch/zli2255/workspace/MergeExpert/checkpoints/baselines_openrs/fmt_MRL4096_ROLLOUT4/global_step_50/actor/huggingface
  parameters:
    weight: 0.9
merge_method: linear
parameters:
  normalize: true
dtype: bfloat16

Zachary1150/merge_linear_cos0.1fmt0.9_MRL4096_ROLLOUT4_LR1e-6

cos0.1fmt0.9

Merge Details

Merge Method

Models Merged

Configuration

Zachary1150/
merge_linear_cos0.1fmt0.9_MRL4096_ROLLOUT4_LR1e-6