Views
No views yet
meta-llama/Meta-Llama-3-8Bmerge_and_unload) into full weights2026-02-24T03:56:05+00:00<TASK:VERIFY>: SUPPORTS/REFUTES/NEI claim verification<TASK:QA>: yes/no/maybe abstract-grounded QA<TASK:RERANK>: 0-3 relevance scoring used for ranking| Metric | Baseline (pre-rerun) | Post-train |
|---|---|---|
| Verify Accuracy | 0.5333 | 0.6667 |
| Verify Macro-F1 | 0.5385 | 0.6592 |
| QA Accuracy | 0.4000 | 0.5333 |
| QA Majority Baseline | 0.4000 | 0.4000 |
| Rerank Pair Accuracy | 0.3500 | 0.4667 |
| Rerank MRR@10 | 0.2667 | 0.5708 |
| Rerank Recall@1 | 0.0000 | 0.5000 |
| Rerank Recall@3 | 0.3333 | 0.5000 |
| Rerank Recall@5 | 0.5000 | 0.6667 |
eval/ metrics JSON filescode/ dataset/training/eval scripts used in this release