This repository models and datasets discussed in our paper “….”
Our pretraining code is based on TensorFlow (checked on 1.15), while fine-tuning is based on PyTorch (1.7.1) and Transformers (2.9.0). Note each has its own requirements.
…..
The FSL tuning has different requirements than pretraining, as it uses HuggingFace's Transformers library. Create a virtual environment and execute
Please Note: If you want to reproduce results from the paper or run with a QASS head in general, questions need to be augmented with a [QUESTION] token. In order to do so, please run
This will add a [MASK] token to each question in the training data, which will later be replaced by a [QUESTION] token automatically by the QASS layer implementation.
Download the Arabic QA benchmark datasets (TyDi QA and ARCD) from the following command
If you use this work in your research, please cite it using the following BibTeX entry:
1 @article{YourLastName2023,
2 title={...},
3 author={...},
4 journal={...},
5 volume={...},
6 number={...},
7 pages={...},
8 year={2023},
9 publisher={...}
10}
For any further inquiries, you can reach me at [
asalrayzah@gmail.com]
