Views
No views yet
1### User:
2{instruction}
3
4### Assistant:
5{response}1import torch
2from transformers import AutoModelForCausalLM, AutoTokenizer
3
4tokenizer = AutoTokenizer.from_pretrained("wkshin89/Yi-Ko-6B-Instruct-v1.1")
5model = AutoModelForCausalLM.from_pretrained(
6 "wkshin89/Yi-Ko-6B-Instruct-v1.1",
7 device_map="auto",
8 torch_dtype=torch.bfloat16,
9)