Views
No views yet
qwen3 template + enable_thinking: true).math_think_s1 — 75,905 ShareGPT samplesstage1-76k.json)| Item | Value |
|---|---|
| Framework | LLaMA-Factory |
| Method | Full SFT, DeepSpeed ZeRO-3 |
| Template | qwen3 (reasoning / thinking) |
| Cutoff | 32768 |
| Packing | true |
| Epochs | 4 |
| LR | 1e-5 (cosine, warmup 10%) |
| Batch | 1 × 16 grad accum × 4 GPUs = 64 |
| Steps | 944 |
| Train loss | 0.6066 |
| Runtime | ~39.3 h |
1from transformers import AutoModelForCausalLM, AutoTokenizer
2
3model_id = "YOUR_HF_USERNAME/math-think-s1-qwen3-4b" # replace after upload
4tokenizer = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True)
5model = AutoModelForCausalLM.from_pretrained(model_id, torch_dtype="auto", device_map="auto")
6
7messages = [{"role": "user", "content": "Find the sum of all positive integers n such that n^2 + 12n - 2007 is a perfect square."}]
8text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True, enable_thinking=True)model.safetensors, config.json, generation_config.json, tokenizer files, chat_template.jinja, README.md, train_results.json, trainer_log.jsonl, MANIFEST.txt.