AMRBART model is continually pre-trained on the English text and AMR Graphs based on the BART model. It was introduced in the paper:
Graph Pre-training for AMR Parsing and Generation by bai et al. in ACL 2022 and first released in
this repository.
AMRBART follows the BART model which uses a transformer encoder-encoder architecture. AMRBART is pre-trained with 6 tasks:
AMRBART is particularly effective when fine-tuned for AMR parsing and AMR-to-text generation tasks.
The AMRBART model is pre-trained on
AMR3.0, a dataset consisting of 55,635
training instances and
English Gigaword (we randomly sampled 200,000 sentences).
You can use the raw model for either AMR encoding or AMR parsing, but it's mostly intended to
be fine-tuned on a downstream task.
1from transformers import BartForConditionalGeneration
2model = BartForConditionalGeneration.from_pretrained("xfbai/AMRBART-base")
Please refer to
this repository for tokenizer initialization and data preprocessing.
1@inproceedings{bai-etal-2022-graph,
2 title = "Graph Pre-training for {AMR} Parsing and Generation",
3 author = "Bai, Xuefeng and
4 Chen, Yulong and
5 Zhang, Yue",
6 booktitle = "Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)",
7 month = may,
8 year = "2022",
9 address = "Online",
10 publisher = "Association for Computational Linguistics",
11 url = "todo",
12 doi = "todo",
13 pages = "todo"
14}
