Views
No views yet
transformers library.| Subset | Accuracy |
|---|---|
| Olympiad | 0.484 |
| Minerva | 0.460 |
| Math | 0.874 |
| AMC | 0.610 |
| AIME24 | 0.332 |
| AIME25 | 0.263 |
| AVG | 0.504 |
Accuracy is measured via exact match on extracted final answers using rule-based labeling functions.
1from transformers import AutoModelForCausalLM, AutoTokenizer
2
3model = AutoModelForCausalLM.from_pretrained("your-org/math-sft-model")
4tokenizer = AutoTokenizer.from_pretrained("your-org/math-sft-model")
5
6prompt = "If \\(2x + 3 = 7\\), what is the value of \\(x\\)?"
7inputs = tokenizer(prompt, return_tensors="pt")
8outputs = model.generate(**inputs, max_new_tokens=128)
9
10print(tokenizer.decode(outputs[0], skip_special_tokens=True))