MoECE is a grammatical error correction model built by converting T5-v1.1 models into mixture-of-expert models. MoECE is more computationally efficient than the original T5 models and produces interpretable corrections by identifying the error types for each correction token.
The safety warning is caused by the checkpoints being saved in pickle format. These checkpoints were generated using the Fairseq library and are not directly compatible with the Transformers library. Please refer to the
official repository for instructions on how to use the models.
MoECE was introduced in the following paper (
PDF):
1@inproceedings{qorib-etal-2024-efficient,
2 title = "Efficient and Interpretable Grammatical Error Correction with Mixture of Experts",
3 author = "Qorib, Muhammad Reza and
4 Aji, Alham Fikri and
5 Ng, Hwee Tou",
6 booktitle = "Findings of the 2024 Conference on Empirical Methods in Natural Language Processing",
7 month = nov,
8 year = "2024",
9 address = "Miami",
10 publisher = "Association for Computational Linguistics",
11}
