Mnemosyne-7B is an experimental large language model (LLM) created by merging several pre-trained models designed for informative and educational purposes. It combines the strengths of these models with the hope of achieving a highly informative and comprehensive LLM.
This is an experimental model, and its performance and capabilities are not guaranteed. Further testing and evaluation are required to assess its effectiveness.
1models:
2 - model: MaziyarPanahi/Mistral-7B-Instruct-KhanAcademy-v0.2
3 - model: openbmb/Eurus-7b-kto
4 - model: Weyaxi/Newton-7B
5merge_method: model_stock
6base_model: mistralai/Mistral-7B-Instruct-v0.2
7dtype: bfloat16
8
Mnemosyne-7B is a merge of the following models using
mergekit:
