/local/scratch/zli2255/workspace/MergeExpert/checkpoints/baselines_openrs/len_MRL4096_ROLLOUT4_LR1e-6/global_step_50/actor/huggingface
/local/scratch/zli2255/workspace/MergeExpert/checkpoints/baselines_openrs/fmt_MRL4096_ROLLOUT4/global_step_50/actor/huggingface

Configuration

The following YAML configuration was used to produce this model:

yaml

models:
- model: /local/scratch/zli2255/workspace/MergeExpert/checkpoints/baselines_openrs/len_MRL4096_ROLLOUT4_LR1e-6/global_step_50/actor/huggingface
  parameters:
    weight: 0.7
- model: /local/scratch/zli2255/workspace/MergeExpert/checkpoints/baselines_openrs/fmt_MRL4096_ROLLOUT4/global_step_50/actor/huggingface
  parameters:
    weight: 0.3
merge_method: linear
parameters:
  normalize: true
dtype: bfloat16

Zachary1150/merge_linear_len0.7fmt0.3_MRL4096_ROLLOUT4_LR1e-6

len0.7fmt0.3

Merge Details

Merge Method

Models Merged

Configuration

Zachary1150/
merge_linear_len0.7fmt0.3_MRL4096_ROLLOUT4_LR1e-6