Views
No views yet
bitsandbytes quantization config was used during training:1@inproceedings{christ-etal-2024-mathwell,
2 title = "{MATHWELL}: Generating Educational Math Word Problems Using Teacher Annotations",
3 author = "Christ, Bryan R and
4 Kropko, Jonathan and
5 Hartvigsen, Thomas",
6 editor = "Al-Onaizan, Yaser and
7 Bansal, Mohit and
8 Chen, Yun-Nung",
9 booktitle = "Findings of the Association for Computational Linguistics: EMNLP 2024",
10 month = nov,
11 year = "2024",
12 address = "Miami, Florida, USA",
13 publisher = "Association for Computational Linguistics",
14 url = "https://aclanthology.org/2024.findings-emnlp.696",
15 pages = "11914--11938",
16 abstract = "Math word problems are critical K-8 educational tools, but writing them is time consuming and requires extensive expertise. To be educational, problems must be solvable, have accurate answers, and, most importantly, be educationally appropriate. We propose that language models have potential to support K-8 math education by automatically generating word problems. However, evaluating educational appropriateness is hard to quantify. We fill this gap by having teachers evaluate problems generated by LLMs, who find existing models and data often fail to be educationally appropriate. We then explore automatically generating *educational* word problems, ultimately using our expert annotations to finetune a 70B language model. Our model, MATHWELL, is the first K-8 word problem generator targeted at educational appropriateness. Further expert studies find MATHWELL generates problems far more solvable, accurate, and appropriate than public models. MATHWELL also matches GPT-4{'}s problem quality while attaining more appropriate reading levels for K-8 students and avoiding generating harmful questions.",
17}