Views
No views yet
A large-scale Korean reasoning model fine-tuned from kakaocorp/kanana-nano-2.1b-instruct, designed to excel in logical and multi-hop reasoning tasks in Korean.
- 📊 All benchmarks were measured using the 0-shot CoT (Chain-of-Thought) method.
- 📊 The Score represents either the accuracy (%) of correct answers or a rating on a 1-10 scale from a judge model.
| Benchmark | Score |
|---|---|
| GPQA diamond | 44.3 |
| GSM8K | 54.1 |
| HAERAE | 50.3 |
| KSM | 35.2 |
| Math500 | 66.9 |
pip install -U transformers1from transformers import AutoModelForCausalLM, AutoTokenizer
2
3model_name = "DimensionSTP/kanana-nano-2.1b-instruct-Ko-Reasoning"
4
5model = AutoModelForCausalLM.from_pretrained(
6 model_name,
7 torch_dtype="auto",
8 device_map="auto"
9)
10tokenizer = AutoTokenizer.from_pretrained(model_name)
11
12prompt = "서울과 부산 중 어디가 더 커?"
13messages = [
14 {"role": "user", "content": prompt}
15]
16text = tokenizer.apply_chat_template(
17 messages,
18 tokenize=False,
19 add_generation_prompt=True
20)
21
22model_inputs = tokenizer([text], return_tensors="pt").to(model.device)
23
24generated_ids = model.generate(
25 **model_inputs,
26 max_new_tokens=4096
27)
28generated_ids = [
29 output_ids[len(input_ids):] for input_ids, output_ids in zip(model_inputs.input_ids, generated_ids)
30]
31
32response = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0]
33print(response)| Property | Value |
|---|---|
| Architecture | LlamaForCausalLM |
| Parameters | 2.1B |
| Context Length | 8,192 tokens |
| Tokenizer | LlamaTokenizer (BPE) |
main: Final stable version from the last branch