Views
No views yet
adapter_epoch{1,2,3}/, each with adapter_config.json, adapter_model.safetensors, and — for tag runs — tag_deltas.pt, the trained delta on the reserved tag embedding rows), plus train_config.json and, for tag runs, tag_init.pt (the seeded tag-row initialization). Attribution runs additionally carry code.pt (the mark vector) and coded_mask.npy (which training docs were marked). Merged full checkpoints are not uploaded; recreate them with merge_and_unload().| Subfolder | Source training run | Base model | Runs |
|---|---|---|---|
exp1-tag-2x2/ | Experiment 1 — reserved-tag 2×2 (seed 17) | Qwen3-8B | P-trainable, P-frozen, S-trainable, S-frozen |
exp3-tag-seed-study/ | Experiment 3 — tag seed replication | Qwen3-8B | {P-trainable,P-frozen}-s{43,91} |
exp4-verdict-w-sweep/ | Experiment 4 — verdict-token loss-weight sweep | Qwen3-8B | s-trainable-w{5,20,50,150,400} |
exp5-dose-marked/ | Experiment 5 — training-time attribution (dose-marked) | Qwen3-8B | {control,d1,d10,d100}-s{17,43} |
exp8-llama-transfer/ | Experiment 8 — model-family transfer | Llama-3.1-8B | {P-trainable,P-frozen}-s{17,43}, {control,d100}-s17 |
exp9-wsweep-seed-rep/ | Experiment 9 — w-sweep seed replication | Qwen3-8B | s-trainable-w{150,50}-s{43,91} |
1import torch
2from transformers import AutoModelForCausalLM
3from peft import PeftModel
4
5base = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3-8B", dtype=torch.bfloat16)
6model = PeftModel.from_pretrained(
7 base,
8 "siddharthmb/mats-gf-metadata-tags-adapters",
9 subfolder="exp1-tag-2x2/P-trainable/adapter_epoch3",
10)
11# optional: model = model.merge_and_unload()tag_deltas.pt (and see tag_init.pt for the seeded initialization) with the loaders in the GitHub repo (src/gf_metadata_tags/tag_tokens/), which handle this for you. exp8-llama-transfer subfolders use meta-llama/Llama-3.1-8B as the base.exp8-llama-transfer/ are derivatives of Llama-3.1-8B (Llama 3.1 Community License); all other subfolders derive from Qwen3-8B (Apache 2.0).