๐ฐ๐ท๐ korean-wikipedia-edudevngho/korean_wikipedia์ 20240701-filtered subset์ devngho/ko_edu_classifier_v2_nlpai-lab_KoE5 ๋ชจ๋ธ๋ก ํ๊ฐํ ๋ฐ์ดํฐ์
from datasets import load_dataset
ds = load_dataset("devngho/korean-wikipedia-edu", name="scored_over_3", split="train")
์์
Google Cloud TPU, transformers, JAX, tpuswarm
TPU v4-8 x 4 instances, ์ฝ 10๋ถ ์์
์ด ์ฐ๊ตฌ๋ Google์ TPU Research Cloud (TRC)์ Cloud TPU ์ ๊ณต์ผ๋ก ์ํ๋์์ต๋๋ค. โก
๋ผ์ด์ ์คโฆ See the full description on the dataset page: https://huggingface.co/datasets/devngho/korean-wikipedia-edu.
