The FusionNet_7Bx2_MoE_v0.1 is a model to experiment with the MoE method, which could significantly increase the performance of the original model. The FusionNet has 12.9B parameters, and this model is fine-tuned. Enjoy!

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric	Value
Avg.	76.16
AI2 Reasoning Challenge (25-Shot)	74.06
HellaSwag (10-Shot)	88.90
MMLU (5-Shot)	65.00
TruthfulQA (0-shot)	71.20
Winogrande (5-shot)	87.53
GSM8k (5-shot)	70.28

TomGrc/FusionNet_7Bx2_MoE_v0.1

FusionNet_7Bx2_MoE_v0.1

Model description

Open LLM Leaderboard Evaluation Results

TomGrc/
FusionNet_7Bx2_MoE_v0.1