You can deploy this model and start earning money today!

sxiong/
SWAP_v1_GSM8K_Gen_Llama3-8B

Name: SWAP_v1_GSM8K_Gen_Llama3-8B
Availability: InStock

safetensors

llama

sxiong/SWAP

meta-llama/Meta-Llama-3-8B-Instruct

finetune

mit

Views

No views yet

SWAP_v1 GSM8K Generator (Llama3-8B)

This repository contains the GSM8K generator (Llama3-8B) trained with SWAP_v1.

Usage

python

from transformers import AutoModelForCausalLM, AutoTokenizer

base_model_id = "sxiong/SWAP_v1_GSM8K_Gen_Llama3-8B"

tokenizer = AutoTokenizer.from_pretrained(base_model_id)

model = AutoModelForCausalLM.from_pretrained(
    base_model_id,
    torch_dtype=torch.bfloat16,
    device_map="auto",
)

For additional information and implementation details, please refer to the SWAP GitHub repository.

Citation

@inproceedings{xiong2025deliberate,
  title={Deliberate reasoning in language models as structure-aware planning with an accurate world model},
  author={Xiong, Siheng and Payani, Ali and Yang, Yuan and Fekri, Faramarz},
  booktitle={Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
  pages={31900--31931},
  year={2025}
}