Views
No views yet
{"point": 0|1, "reason": "..."} matching the official College Board Row A decision.| model | agreement | Cohen's κ | false-deny | false-award |
|---|---|---|---|---|
| base Qwen3-0.6B (untuned) | 79% | 0.10 | 0 | 14 |
| this adapter (tuned) | 80% | 0.54 | 13 | 1 |
| gpt-4o (hardened prompt) | 75% | 0.39 | 14 | 4 |
| gpt-4o (decomposed) | 82% | 0.49 | 8 | 5 |
1from transformers import AutoModelForCausalLM, AutoTokenizer
2from peft import PeftModel
3
4tok = AutoTokenizer.from_pretrained("Qwen/Qwen3-0.6B")
5m = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3-0.6B")
6m = PeftModel.from_pretrained(m, "<this-repo>")
7# Use the compact system prompt from src/rowa/rubric.py (grader_system("compact")).Brainlift.md for method.