merge

Name: fq2.5-7b-it-normalize_true
Availability: InStock

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Model Stock merge method using Qwen/Qwen2.5-7B-Instruct as a base.

Models Merged

The following models were included in the merge:

prithivMLmods/QwQ-MathOct-7B
Orion-zhen/Qwen2.5-7B-Instruct-Uncensored
Rombo-Org/Rombo-LLM-V2.5-Qwen-7b
prithivMLmods/Deepthink-Reasoning-7B
fblgit/cybertron-v4-qw7B-MGS
Krystalan/DRT-o1-7B
Bui1dMySea/LongRAG-Qwen2.5-7B-Instruct
Spestly/Athena-1-7B
prithivMLmods/QwQ-LCoT-7B-Instruct

Configuration

The following YAML configuration was used to produce this model:

yaml

models:
  - model: Rombo-Org/Rombo-LLM-V2.5-Qwen-7b
  - model: fblgit/cybertron-v4-qw7B-MGS
  - model: Spestly/Athena-1-7B
  - model: Orion-zhen/Qwen2.5-7B-Instruct-Uncensored
  - model: prithivMLmods/Deepthink-Reasoning-7B
  - model: prithivMLmods/QwQ-LCoT-7B-Instruct
  - model: prithivMLmods/QwQ-MathOct-7B
  - model: Bui1dMySea/LongRAG-Qwen2.5-7B-Instruct
  - model: Krystalan/DRT-o1-7B
merge_method: model_stock
base_model: Qwen/Qwen2.5-7B-Instruct
normalize: true
int8_mask: true
dtype: bfloat16

ehristoforu/fq2.5-7b-it-normalize_true

merge

Merge Details

Merge Method

Models Merged

Configuration

ehristoforu/
fq2.5-7b-it-normalize_true