You can deploy this model and start earning money today!

appvoid/
arco-2.1

Name: arco-2.1
Rating: 2.5 (13 reviews)

safetensors

llama

apache-2.0

Views

No views yet

cubby
This is the latest iteration as an effort to make arco as good on arc as it can. So far it improved a little.
promptthere is no prompt intentionally set.
benchmarkszero-shot results from state-of-the-art small language models
ParametersModelMMLUARC-CHellaSwagPIQAWinograndeAverage
0.5bdanube 324.8136.1860.4673.7861.0151.25
0.5barco26.1737.2962.8874.3762.2752.60
0.5barco 225.5138.8263.0274.7061.2552.66
0.5barco 2º25.4738.9963.0374.7061.0152.64
supportersBuy Me A Coffee
triviaarco seems to keep improving on the same 3 benchmarks, reached its limit though.

Parameters	Model	MMLU	ARC-C	HellaSwag	PIQA	Winogrande	Average
0.5b	danube 3	24.81	36.18	60.46	73.78	61.01	51.25
0.5b	arco	26.17	37.29	62.88	74.37	62.27	52.60
0.5b	arco 2	25.51	38.82	63.02	74.70	61.25	52.66
0.5b	arco 2º	25.47	38.99	63.03	74.70	61.01	52.64

appvoid/arco-2.1

prompt

benchmarks

supporters

trivia

appvoid/
arco-2.1