Views
No views yet
Qwen/Qwen3.5-27B base model, it underwent LoRA-based fine-tuning to improve its logical reasoning performance.| Model | Avg | KMMLU-Pro | CLIcK | HLE(Ko) | MuSR(Ko) | Com2-main | KMMLU | COPA | HellaSwag |
|---|---|---|---|---|---|---|---|---|---|
| QuettaLLMs-27B-Koreasoner-V3 | 0.560 | 0.676 | 0.794 | 0.070 | 0.604 | 0.654 | 73.8 | 81.9 | 52.4 |
| Qwen3.5-27B (Base) | 0.530 | 0.622 | 0.770 | 0.058 | 0.577 | 0.622 | 68.50 | 79.3 | 49.0 |
Result Summary: Metrics such as KMMLU-Pro (+0.054), CLIcK (+0.024), and KMMLU (+5.30p) increased compared to the base model, indicating an overall improvement in Korean domain knowledge and context understanding.