Views
No views yet
Ko-LLM leaderboard(11/23; link)
| Model | Average | Ko-ARC | Ko-HellaSwag | Ko-MMLU | Ko-TruthfulQA | Ko-CommonGen V2 |
|---|---|---|---|---|---|---|
| [...your_model_name...] | NaN | NaN | NaN | NaN | NaN | NaN |
AI-Harness evaluation; link
| Model | Copa | Copa | HellaSwag | HellaSwag | BoolQ | BoolQ | Sentineg | Sentineg |
|---|---|---|---|---|---|---|---|---|
| 0-shot | 5-shot | 0-shot | 5-shot | 0-shot | 5-shot | 0-shot | 5-shot | |
| SOLAR-10.7B-v1.0-Instruct | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN |
1### KO-Platypus
2from transformers import AutoModelForCausalLM, AutoTokenizer
3import torch
4
5repo = "[...your_model_repo...]"
6OpenOrca = AutoModelForCausalLM.from_pretrained(
7 repo,
8 return_dict=True,
9 torch_dtype=torch.float16,
10 device_map='auto'
11)
12OpenOrca_tokenizer = AutoTokenizer.from_pretrained(repo)