Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

TinyMathLlama-1.1B – AI Model by schwp | AlphaNeural AI

You can deploy this model and start earning money today!

schwp/
TinyMathLlama-1.1B

like

0

text-generation

meta-math/MetaMathQA

TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T

text-generation-inference

endpoints_compatible

Views

No views yet

TinyMathLlama-1.1B

TinyLlama-1.1B fine-tuned on MetaMathQA using a from-scratch LoRA implementation.

LoRA config: r=8, $\alpha$=16, target modules: q_proj + v_proj
Training data: 10k samples from MetaMathQA
GSM8K accuracy: 3.0% (base: 1.5%, 2x improvement)
Trainable params: 1,126,400 / 1,101,174,784 (0.1%)

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer model = AutoModelForCausalLM.from_pretrained("schwp/schwp/TinyMathLlama-1.1B")

Training & Evaluation

The training and evaluation scripts are available on this github repository. The whole LoRA implementation used for the fine-tuning is also on the repository.