Is this your dataset? Claim it with the Hugging Face account that owns it.

malaysia-ai/
pretrain-text-dataset

Name: pretrain-text-dataset
Creator: malaysia-ai

Views

No views yet

Dataset Introduction

This dataset is a collection of malaysian texts in the Malay, English, Chinese, and Tamil languages, gathered by Malaysia AI volunteers through web crawling of malaysian websites. The dataset amounts to approximately 250 GB of text data, and has undergone deduplication process.

Project Link

To learn more about this project, https://github.com/users/huseinzol05/projects/1/views/1 We no longer update the project.

Github Repository

Our data… See the full description on the dataset page: https://huggingface.co/datasets/malaysia-ai/pretrain-text-dataset.