Views
No views yet
| Benchmark | Accuracy |
|---|---|
| AIME24 | 41.0% |
| AIME25 | 29.4% |
| AMC23 | 70.0% |
| MATH500 | 85.8% |
| Olympiad | 55.6% |
| Average | 56.4% |
1git clone https://github.com/ChengpengLi1003/CoRT.git
2cd CoRT
3# Follow installation instructions in the repository1TOKENIZERS_PARALLELISM=false VLLM_USE_V1=1 python -m infer.inference_vllm_dp_mj \
2 --input_file <path_to_input_file_in_jsonl> \
3 --start 0 \
4 --end 0 \
5 --output_dir <path_to_output_dir> \
6 --model_name_or_path <path_to_this_model> \
7 --engine vllm \
8 --temperature 0.6 \
9 --top_p 0.95 \
10 --n_sampling 16 \
11 --stop_tokens_mode normal_code_block_end \
12 --max_tokens_per_call 32768 \
13 --max_model_len 32768 \
14 --max_func_call 15 \
15 --func_call_mode jupyter \
16 --data_parallel_size 1 \
17 --tensor_parallel_size 1prompt field:1{
2 "prompt": "Every morning Aya goes for a $9$-kilometer-long walk and stops at a coffee shop afterwards. When she walks at a constant speed of $s$ kilometers per hour, the walk takes her 4 hours, including $t$ minutes spent in the coffee shop. When she walks $s+2$ kilometers per hour, the walk takes her 2 hours and 24 minutes, including $t$ minutes spent in the coffee shop. Suppose Aya walks at $s+\\frac{1}{2}$ kilometers per hour. Find the number of minutes the walk takes her, including the $t$ minutes spent in the coffee shop.\nPlease integrate natural language reasoning with python programs to solve the problem above, and put your final answer within \\boxed{}."
3}1@misc{li2025cortcodeintegratedreasoningthinking,
2 title={CoRT: Code-integrated Reasoning within Thinking},
3 author={Chengpeng Li and Zhengyang Tang and Ziniu Li and Mingfeng Xue and Keqin Bao and Tian Ding and Ruoyu Sun and Benyou Wang and Xiang Wang and Junyang Lin and Dayiheng Liu},
4 year={2025},
5 eprint={2506.09820},
6 archivePrefix={arXiv},
7 primaryClass={cs.CL},
8 url={https://arxiv.org/abs/2506.09820},
9}