This is a model using the llama2 architecture and only 2 million parameters. It is trained on approximately 2 billion tokens of diverse web data from the first 1000000 rows of the uncleaned c4 english dataset.

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric	Value
Avg.	3.46
IFEval (0-Shot)	15.82
BBH (3-Shot)	3.12
MATH Lvl 5 (4-Shot)	0.00
GPQA (0-shot)	0.00
MuSR (0-shot)	0.53
MMLU-PRO (5-shot)	1.26

cpayne1303/smallcp2024

Model Description

Open LLM Leaderboard Evaluation Results

cpayne1303/
smallcp2024