from transformers import AutoModelForCausalLM, AutoTokenizer
tok = AutoTokenizer.from_pretrained("Loke-60000/rin-4b")
model = AutoModelForCausalLM.from_pretrained("Loke-60000/rin-4b", device_map="auto")
msgs = [{"role": "user", "content": "Write a Python function to reverse a string."}]
inputs = tok.apply_chat_template(msgs, add_generation_prompt=True, return_tensors="pt").to(model.device)
print(tok.decode(model.generate(**{"input_ids": inputs}, max_new_tokens=512)[0]))

Loke-60000/rin-4b-exp

Rin

Usage

Loke-60000/
rin-4b-exp