Views
No views yet
| Field | Value |
|---|---|
| Unlearning method | CRISP |
| Base model | meta-llama/Llama-3.1-8B-Instruct |
| Target concept | Cannabis |
| Checkpoint type | LoRA Adapter |
| Rank / seed | 200 / 42 |
| Train eval protocol | mc |
unlearned_checkpoints.json):| Parameter | Value |
|---|---|
alpha | 5 |
delta_embed | 0 |
k_features | 20 |
k_features_embed | 0 |
layer_hi | 19 |
layer_lo | 5 |
layer_step | 2 |
lora_rank | 4 |
lr | 0.0005 |
n_tokens_edited | 0 |
num_epochs | 2 |
| Metric | Train (after unlearning) | Test (after unlearning) |
|---|---|---|
| Efficacy | 0.537 | 0.575 |
| Specificity | 0.715 | 0.72 |
| Harmonic mean | 0.613 | 0.64 |
| Relearning QA (MC) | — | 0.86 |
evaluation/score_comparison.csv:| Metric | Baseline (train) | After unlearn (train) | Baseline (test) | After unlearn (test) |
|---|---|---|---|---|
| QA accuracy | 0.92 | 0.56 | 0.98 | 0.56 |
| QA fraction | 1 | 0.463 | 1 | 0.425 |
| SimDom accuracy | 0.94 | 0.68 | 0.86 | 0.66 |
| SimDom fraction | 1 | 0.623 | 1 | 0.672 |
| MMLU accuracy | 0.62 | 0.56 | 0.65 | 0.56 |
| MMLU fraction | 1 | 0.838 | 1 | 0.775 |
| File | Description |
|---|---|
unlearned_checkpoints.json | Checkpoint metadata & hyperparameters |
evaluation/evaluation_summary.json | Full evaluation payload (train/test/relearning) |
evaluation/score_comparison.csv | Baseline vs. unlearned comparison table |