Views
No views yet
1from sentence_transformers import SentenceTransformer
2from setfit import SetFitModel, SetFitTrainer
3
4# Download from the 🤗 Hub
5model = SetFitModel.from_pretrained(
6 "rafaelsandroni/classifier-hallucination-projectJ"
7)
8
9# Run inference
10preds = model("Para transferir R$ 500,00 para a chave Pix '+123123123123', vou realizar a transação agora.")
11print(preds)| Hallucinated | Count |
|---|---|
| False | 97 |
| True | 39 |
| Epoch | Training Loss | Validation Loss |
|---|---|---|
| 1 | 0.000400 | 0.067576 |
| 2 | 0.000200 | 0.073225 |
| 3 | 0.000200 | 0.093793 |
| 4 | 0.000100 | 0.096496 |
| 5 | 0.000100 | 0.100173 |
| 6 | 0.000100 | 0.102722 |
| Accuracy |
|---|
| 0.9926470588235294 |
