You can deploy this model and start earning money today!

alvinming/
es-qwen-math-base-7b-3k-stage2-6k-t4-ds_o2_aug-kl0.01-step480

Name: es-qwen-math-base-7b-3k-stage2-6k-t4-ds_o2_aug-kl0.01-step480
Availability: InStock

text-generation-inference

endpoints_compatible

Views

No views yet

SparkleRL-7B-Stage2-aug is the Stage 2 RL-tuned model with partial-step scaffolding used in the paper Beyond Accuracy: Dissecting Mathematical Reasoning for LLMs Under Reinforcement Learning.

Links

Paper: https://arxiv.org/abs/2506.04723

Code: https://github.com/sparkle-reasoning/sparkle

Project Page: https://sparkle-reasoning.github.io/

Quick Start

python

from transformers import AutoTokenizer, AutoModelForCausalLM
import torch

name = "sparkle-reasoning/SparkleRL-7B-Stage2-aug"

tok = AutoTokenizer.from_pretrained(name)
model = AutoModelForCausalLM.from_pretrained(
    name, torch_dtype=torch.float16, device_map="auto"
)

prompt = "Solve step by step: If 3x + 5 = 20, what is x?"
inp = tok(prompt, return_tensors="pt").to(model.device)
out = model.generate(**inp, max_new_tokens=256)

print(tok.decode(out[0], skip_special_tokens=True))

Citation

bibtex

@misc{wang2025accuracydissectingmathematicalreasoning,
    title={Beyond Accuracy: Dissecting Mathematical Reasoning for LLMs Under Reinforcement Learning}, 
    author={Jiayu Wang and Yifei Ming and Zixuan Ke and Caiming Xiong and Shafiq Joty and Aws Albarghouthi and Frederic Sala},
    year={2025},
    eprint={2506.04723},
    archivePrefix={arXiv},
    primaryClass={cs.AI},
    url={https://arxiv.org/abs/2506.04723},
}

alvinming/es-qwen-math-base-7b-3k-stage2-6k-t4-ds_o2_aug-kl0.01-step480

Links

Quick Start

Citation

alvinming/
es-qwen-math-base-7b-3k-stage2-6k-t4-ds_o2_aug-kl0.01-step480