from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

base_model = AutoModelForCausalLM.from_pretrained(
    "moonshotai/Kimi-K2-Thinking",
    trust_remote_code=True
)
model = PeftModel.from_pretrained(base_model, "YOUR_USERNAME/perry-anderson-lora")
tokenizer = AutoTokenizer.from_pretrained(
    "moonshotai/Kimi-K2-Thinking",
    trust_remote_code=True
)

# Generate text
inputs = tokenizer("The trajectory of European socialism", return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=200)
print(tokenizer.decode(outputs[0]))

Training Details

Base Model: moonshotai/Kimi-K2-Thinking
LoRA Rank: 32
Training: 5 epochs on ~100k words of Perry Anderson&#x27;s essays
Fine-tuning Platform: Tinker API

Fine-tuned using causal language modeling on excerpts from Perry Anderson's essays and books, including works from New Left Review and Verso publications.

d0ks/perry-anderson-lora

Perry Anderson Style LoRA

Model Details

Writing Style

Usage

Training Details

d0ks/
perry-anderson-lora