This model was abliterated using
heretic — a tool that identifies and removes refusal directions in language models via activation patching.
The process targets specific model layers responsible for refusal behavior while leaving the rest of the model (reasoning, tool-use, coding) fully intact.
1from transformers import AutoModelForCausalLM, AutoTokenizer
2
3model = AutoModelForCausalLM.from_pretrained(
4 "hotdogs/Agents-A1-4B-kimi-Preview-heretic",
5 torch_dtype="auto",
6 device_map="auto",
7 trust_remote_code=True
8)
9tokenizer = AutoTokenizer.from_pretrained("hotdogs/Agents-A1-4B-kimi-Preview-heretic")
10
11messages = [{"role": "user", "content": "Write a Python function to sort a list"}]
12inputs = tokenizer.apply_chat_template(messages, tokenize=True, return_tensors="pt")
13outputs = model.generate(inputs, max_new_tokens=256, temperature=0.6)
14print(tokenizer.decode(outputs[0]))
Dataset:
greghavens/kimi-k3-coding-and-debugging-traces — 3,389 clean coding agent traces, 3 epochs, scale=0.4.