CamemBERT-base fine-tuned on
QFrCoLA
(Beauchemin & Khoury, EMNLP 2025), a Quebec-French corpus of binary linguistic
acceptability judgments (0 = ungrammatical, 1 = grammatical/acceptable in Quebec French).
Trained as part of a CSCI 5501 (Deep Learning Applications, Dalhousie University)
mini-project quantifying and reducing the Quebec-French acceptability-judgment gap
in pretrained French language models. See the accompanying
Space demo and project report for zero-shot vs. fine-tuned comparisons.
1from transformers import AutoTokenizer, AutoModelForSequenceClassification
2import torch
3
4tok = AutoTokenizer.from_pretrained("hineshp6/camembert-qfrcola")
5model = AutoModelForSequenceClassification.from_pretrained("hineshp6/camembert-qfrcola")
6
7sentence = "Il fait frette dehors a matin."
8inputs = tok(sentence, return_tensors="pt")
9probs = torch.softmax(model(**inputs).logits, dim=-1)[0]
10print(f"P(acceptable) = {probs[1]:.3f}")
Fine-tuned model released under CC-BY-NC-SA 4.0, matching the QFrCoLA dataset license.