Views
No views yet
ingroup.macro_f1 — ingroup macro-F1 on the grouped-split test (see docs/rq_c_report.md).1from transformers import AutoModelForSequenceClassification, AutoTokenizer
2model = AutoModelForSequenceClassification.from_pretrained("calerio/silent-signals-rqc", revision="<branch>")
3tok = AutoTokenizer.from_pretrained("calerio/silent-signals-rqc", revision="<branch>")| Branch | Variant id | ingroup.macro_f1 | Notes |
|---|---|---|---|
patha-seed123 | rqc_pathA_seed123 | 0.3604 | — |
patha-seed42 | rqc_pathA_seed42 | 0.3829 | — |
patha-seed7 | rqc_pathA_seed7 | 0.3933 | default |
pathb-seed42 | rqc_pathB_seed42 | — | HPC-only / not yet pushed |
pathb-seed123 | rqc_pathB_seed123 | — | HPC-only / not yet pushed |
pathb-seed7 | rqc_pathB_seed7 | — | HPC-only / not yet pushed |
rqc_pathA_seed7 — see the per-task default_variant_rationale in data/manifests/model_inventory.json of the project repo.silent_signals corpus (Kruk et al. 2024). Full methodology: docs/DESIGN_DEFENSE.md + per-RQ reports in the project repo. HF Space build write-up: docs/hf_space_report.md.