The FusionNet is a model to experiment with the single passthrough Fusion method, which could significantly increase the performance of the original model. The FusionNet has 21.2B parameters, and this model is fine-tuned. Enjoy!

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric	Value
Avg.	65.74
AI2 Reasoning Challenge (25-Shot)	69.45
HellaSwag (10-Shot)	87.79
MMLU (5-Shot)	65.20
TruthfulQA (0-shot)	67.67
Winogrande (5-shot)	81.53
GSM8k (5-shot)	22.82

TomGrc/FusionNet_passthrough_v0.1

FusionNet

Model description

Open LLM Leaderboard Evaluation Results

TomGrc/
FusionNet_passthrough_v0.1