Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
kogrammar-tiny-distil – AI Model by theSOL1 | AlphaNeural AI
You can deploy this model and start earning money today!
theSOL1
/
kogrammar-tiny-distil
like
0
transformers
pytorch
bart
text2text-generation
grammar
ko
mit
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
kogrammar-tiny-distil
Dataset: 국립국어원 맞춤법 교정 말뭉치
Backbone Model
:
kobart-base-v2
kogrammar-base
Contributors
:
ChangGeon Kang:
NeverAsking
Subin Park:
SOL1archive
GitHub Repo
:
SOL1archive/KoGrammar
Train Method
전체 데이터셋 중 약 67.5%를 학습데이터로 활용하여 학습함.
SFT Distillation을 이용해
kogrammar-base
모델의 Decoder Layer를 6개에서 1개로 줄여 다시 학습시킴.
Metric
BLEU-2
ROUGE-2 F1
77.8 %
55.0 %