Views
No views yet
NurtureAI/neural-chat-7b-v3-16k: Weight - 30%xDAN-AI/xDAN-L1-Chat-RL-v1: Weight - 30%rwitz/go-bruins-v2: Weight - 30%segmed/MedMistral-7B-v0.1: Weight - 10%1from LM_Cocktail import mix_models_by_layers
2
3model = mix_models_by_layers(
4 model_names_or_paths=[
5 "NurtureAI/neural-chat-7b-v3-16k",
6 "xDAN-AI/xDAN-L1-Chat-RL-v1",
7 "rwitz/go-bruins-v2",
8 "segmed/MedMistral-7B-v0.1"
9 ],
10 model_type='decoder',
11 weights=[0.3, 0.3, 0.3, 0.1],
12 output_path='./mixed_llm'
13)