Views
No views yet
checkpoints folder and dataset caches have been intentionally left intact in the local workspace to allow for fine-tuning resumption or running alternative trial comparisons later if required.Qwen3.5-9B)transformers:1from transformers import AutoModelForCausalLM, AutoTokenizer
2
3model_path = "./Qwen3.5-9B-Abliterated"
4
5tokenizer = AutoTokenizer.from_pretrained(model_path)
6model = AutoModelForCausalLM.from_pretrained(
7 model_path,
8 device_map="auto",
9 torch_dtype="auto"
10)
11
12inputs = tokenizer("Hello, how are you?", return_tensors="pt").to(model.device)
13outputs = model.generate(**inputs, max_new_tokens=100)
14print(tokenizer.decode(outputs[0], skip_special_tokens=True))