Views
No views yet
Llama-3-8B-Instruct using Unsloth and LoRA (4-bit NF4 quantization) targeting all linear layers.NLTK), low-latency inference ($T=0.1$), and structured JSON feedback logging for DPO fine-tuning loops.| Model | sacreBLEU | chrF | METEOR | COMET |
|---|---|---|---|---|
| Llama-3-8B-Instruct (LoRA FT) | 82.42 | 87.47 | 0.83 | 0.91 |
| mT5-base (Full FT) | 75.00 | 80.19 | 0.73 | 0.86 |
77.4% ( rewrites accepted without modification )18.5% ( manually edited by users )4.1% ( dismissed suggestions )| Parameter | Value |
|---|---|
| Base Model | Llama-3-8B-Instruct (Unsloth 4-bit NF4) |
| Max Sequence Length | 2048 |
| LoRA Rank ($r$) / Alpha ($ lpha$) | 16 / 16 |
| Target Modules | $q, k, v, o, gate, up, down$ |
| Optimizer / LR | AdamW (8-bit) / $2 imes 10^{-4}$ (Linear Scheduler) |
| Batch Size / Effective Batch Size | 8 per device (Grad Accum = 2) $ |
| ightarrow$ 16 | |
| Epochs | 5 |
1git clone https://github.com/uniba-nlp/FAIR-ISLE.git
2cd FAIR-ISLE
3
4conda create -n fair-isle python=3.10 -y
5conda activate fair-isle
6
7pip install -r requirements.txtpython app.py --model_path uniba-nlp/Llama-3-8B-FAIR-ISLE --port 5000http://localhost:5000.1python train.py \
2 --base_model "unsloth/llama-3-8b-instruct-bnb-4bit" \
3 --dataset_path "./data/fair_isle_dataset.json" \
4 --output_dir "./models/fair-isle-lora" \
5 --epochs 5 \
6 --batch_size 8 \
7 --learning_rate 2e-41<|begin_of_text|><|start_header_id|>system<|end_header_id|>
2
3You are an assistant skilled in inclusive language. Rewrite the sentence provided by the user to make it inclusive. If the sentence is already correct or neutral, return it unchanged.<|eot_id|>
4<|start_header_id|>user<|end_header_id|>
5
6Original sentence: {input_sentence}<|eot_id|>
7<|start_header_id|>assistant<|end_header_id|>
8
9Rewritten sentence: {output_sentence}<|eot_id|>1@inproceedings{filograsso2026fairisle,
2 title = {FAIR-ISLE: A Bilingual Platform for AI-mediated Inclusive Rewriting and Critical Language Awareness},
3 author = {Filograsso, Francesca and Siciliani, Lucia and Maglie, Rosita Belinda and Basile, Pierpaolo and de Gemmis, Marco},
4 booktitle = {Proceedings of the Twelfth Italian Conference on Computational Linguistics (CLiC-it 2026)},
5 year = {2026},
6 address = {Palermo, Italy},
7 publisher = {CEUR Workshop Proceedings}
8}francesca.filograsso@uniba.it) — Department of Education, Psychology and Communication Sciences, University of Bari Aldo Morolucia.siciliani@uniba.it) — Department of Computer Science, University of Bari Aldo Mororosita.maglie@uniba.it) — Department of Education, Psychology and Communication Sciences, University of Bari Aldo Moropierpaolo.basile@uniba.it) — Department of Computer Science, University of Bari Aldo Moromarco.degemmis@uniba.it) — Department of Computer Science, University of Bari Aldo Moro