| Model | kobest_boolq | kobest_copa | kobest_hellaswag | kobest_sentineg | korunsmile | pawsx_ko |
|---|---|---|---|---|---|---|
| Zero-shot | ||||||
| Yi-Ko-6B-Instruct-v1.0 | 0.6619 | 0.7794 | 0.4858 | 0.4589 | 0.3520 | 0.5545 |
| Yi-Ko-6B | 0.7070 | 0.7696 | 0.5009 | 0.4044 | 0.3828 | 0.5145 |
1### User:
2{instruction}
3
4### Assistant:
5{response}1import torch
2from transformers import AutoModelForCausalLM, AutoTokenizer
3
4tokenizer = AutoTokenizer.from_pretrained("wkshin89/Yi-Ko-6B-Instruct-v1.0")
5model = AutoModelForCausalLM.from_pretrained(
6 "wkshin89/Yi-Ko-6B-Instruct-v1.0",
7 device_map="auto",
8 torch_dtype=torch.bfloat16,
9)