Is this your dataset? Claim it with the Hugging Face account that owns it.

ai4bharat/
IndicCorpV2

Name: IndicCorpV2
Creator: ai4bharat

Views

No views yet

	IndicCorp v2 Dataset




	


	Towards Leaving No Indic Language Behind: Building Monolingual Corpora, Benchmark and Models for Indic Languages

This repository contains the pretraining data for the paper published at ACL 2023.

Example Usage

from datasets import load_dataset

Load the Telugu subset of the dataset

dataset = load_dataset("ai4bharat/IndicCorpV2", "indiccorp_v2", data_dir="data/tel_Telu")

License

All the datasets created as… See the full description on the dataset page: https://huggingface.co/datasets/ai4bharat/IndicCorpV2.