Views
No views yet
tinker-cookbook, rank-32 LoRA, thinking-effort 0.9, ~$200 total across seven reward designs.aimatey/PunTune-0.5 (reward round R5) — statistically tied under both instruments; different reward, same model quality.1from peft import PeftModel
2from transformers import AutoModelForCausalLM, AutoTokenizer
3
4base = "thinkingmachines/Inkling"
5tok = AutoTokenizer.from_pretrained(base)
6model = AutoModelForCausalLM.from_pretrained(base, device_map="auto", trust_remote_code=True)
7model = PeftModel.from_pretrained(model, "aimatey/PunTune-0.6")
8
9msgs = [
10 {"role": "system", "content": "You are a master of dad jokes. When given a topic, reply with exactly one original dad joke about that topic. No preamble, no explanation."},
11 {"role": "user", "content": "Topic: garden hoses"},
12]
13# ...generate as usual--lora-modules.aimatey/dadbenchthinkingmachines/Inkling