Views
No views yet
Dorami-Chat is a Direct Preference Optimization(DPO) model based on the Supervised Fine-tuning(SFT) model lucky2me/Dorami-Instructgit lfs install
git clone https://huggingface.co/lucky2me/Dorami-Chat1from transformers import AutoTokenizer, AutoModelForCausalLM, GenerationConfig
2model_path = "The path of the model downloaded above"
3tokenizer = AutoTokenizer.from_pretrained(model_path)
4model = AutoModelForCausalLM.from_pretrained(model_path)
5prompt="fill in any prompt you like."
6inputs = tokenizer(prompt, return_tensors="pt")
7generation_config = GenerationConfig(max_new_tokens=64, do_sample=True, top_k=2, eos_token_id=model.config.eos_token_id)
8outputs = model.generate(**inputs, generation_config=generation_config)
9decoded_text = tokenizer.batch_decode(outputs, skip_special_tokens=True)
10print(decoded_text)