Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
4bit-SmolLM2-natural-reasoning-10k – AI Model by chungimungi | AlphaNeural AI
You can deploy this model and start earning money today!
chungimungi
/
4bit-SmolLM2-natural-reasoning-10k
like
0
peft
safetensors
text-generation
en
facebook/natural_reasoning
HuggingFaceTB/SmolLM2-360M
adapter
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
4bit-SmolLM2-natural-reasoning-10k
fine tuned on
facebook/natural_reasoning
for 10K steps on one RTX4060 using 4bit quantization.
Evaluated using
LightEval
image/png
Framework versions
Optimizer: AdaFactor
Bitsandbytes
PEFT 0.14.0
Results
Dataset
Baseline
Ours
CommonsenseQA
19.5
20.2
PIQA
3.1
12.4
Winogrande
54.6
54.8
HellaSwag
21.7
25.6
MMLU
20.2
19.3
Note:
Scores Taken from here
