Beta
Explore
Marketplace
Neural Labs
Playground
Wallet
Docs
scibert-wechsel-korean – AI Model by LeverageX | AlphaNeural AI
You can deploy this model and start earning money today!
LeverageX
/
scibert-wechsel-korean
like
0
transformers
pytorch
bert
fill-mask
autotrain_compatible
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
scibert-wechsel-korean
Scibert(🇺🇸) converted into Korean(🇰🇷) using WECHSEL technique.
Description
SciBERT is trained on papers from the corpus of semanticscholar.org. Corpus size is 1.14M papers, 3.1B tokens.
Wechsel is converting embedding layer's subword tokens from source language to target language.
SciBERT trained with English language is converted into Korean langauge using Wechsel technique.
Korean tokenizer is selected with KLUE PLMs' tokenizers due to its similar vocab size(32000) and performance.
Reference
Scibert
WECHSEL
Korean Language Understanding Evaluation
