Math Model — Olympiad-Focused SFT Checkpoint

Name: math_model
Rating: 2.5 (15 reviews)

This model is a fine-tuned version of Qwen/Qwen3-1.7B for mathematical reasoning, developed for the CS-552 standard project math track.

The model was trained to solve competition-style mathematics problems and produce final answers in boxed LaTeX format.

Base Model

The final submitted checkpoint was trained on approximately 25,165 examples from hard mathematical reasoning datasets:

The NuminaMath subset was filtered to focus on harder mathematical sources:

The OpenR1 subset was filtered to competition-relevant categories:

Setting	Value
Base model	Qwen/Qwen3-1.7B
Fine-tuning method	LoRA
Epochs	1
LoRA rank	32
LoRA alpha	64
LoRA dropout	0.05
Learning rate	1e-4
Batch size	1
Gradient accumulation steps	8
Precision	bfloat16
Hardware	1 × NVIDIA A100 40GB
Training steps	3,146
Runtime	6,761 seconds
Tokens processed	14.7M
Final training loss	0.6114
Mean token accuracy	0.8302

The submitted generation configuration uses sampling:

json

{
  "do_sample": true,
  "temperature": 0.25,
  "top_p": 0.85,
  "top_k": 30
}