You can deploy this model and start earning money today!

appvoid/
palmer-004-turbo-2407

Name: palmer-004-turbo-2407
Availability: InStock

text-generation-inference

endpoints_compatible

Views

No views yet

palmer-004
July Update - this is a performance balancing over palmer-004-turbo by utilizing slerp merging technique with an internal model codenamed arco - keep in mind, none of these models use specific prompts, you might need to fine-tune them to use them as chatbots.
benchmarkszero-shot evaluations performed on current sota ~0.5b models against the best language model below 2b parameters.
ParametersModelMMLUARC-CHellaSwagPIQAWinograndeAverage
0.5bqwen20.44130.28920.49050.69310.56990.4968
0.6bmobilellm-0.35800.55900.72300.5860-
0.5bdanube30.24810.36180.60460.73780.61010.5125
0.5bpalmer0.27550.36860.60930.73560.61720.5212
1.7bsmollm0.27650.46260.65740.76060.60930.5533
supportersBuy Me A Coffee

Parameters	Model	MMLU	ARC-C	HellaSwag	PIQA	Winogrande	Average
0.5b	qwen2	0.4413	0.2892	0.4905	0.6931	0.5699	0.4968
0.6b	mobilellm	-	0.3580	0.5590	0.7230	0.5860	-
0.5b	danube3	0.2481	0.3618	0.6046	0.7378	0.6101	0.5125
0.5b	palmer	0.2755	0.3686	0.6093	0.7356	0.6172	0.5212
1.7b	smollm	0.2765	0.4626	0.6574	0.7606	0.6093	0.5533

appvoid/palmer-004-turbo-2407

benchmarks

supporters

appvoid/
palmer-004-turbo-2407