Clinical Confidence Collapse Detection
PurposeDetect when a prior working diagnosis should lose confidence fast due to new evidence.
You receive:
working_diagnosis
confidence_before
new_evidence
proposed_next_step
You output one JSON object:
confidence_collapseyes or no
new_confidencefloat 0 to 1
correct_actionone sentence
Scoring
confidence_collapse_accuracy
new_confidence_score
correct_action_similarity
format_pass_rate
Run scoringpython scorer.py --predictions… See the full description on the dataset page:
https://huggingface.co/datasets/ClarusC64/clinical_confidence_collapse_detection_v0.1.
