This repository contains a language adaptation and fine-tuning of the Indobenchmark IndoBERT language model for three specific languages: Balinese, Buginese, and Minangkabau.
The adaptation was performed using
nusa-translation dataset.
We tested the model after it was fine-tuned for topic classification using
nusa-dialogue dataset.
We also tested the model after it was fine-tuned for language identification using
nusaX dataset.
The dataset is released under the terms of
CC-BY-SA 4.0.
By using this model, you are also bound to the respective Terms of Use and License of the dataset.
For commercial use in small businesses and startups, please contact us (
business@prosa.ai) for permission to use the datasets by informing company profile and propose of usage.
This research work is funded and supported by The Deutsche Gesellschaft für Internationale Zusammenarbeit (GIZ) GmbH and FAIR Forward - Artificial Intelligence for all. We thank Direktorat Jenderal Pendidikan Tinggi, Riset, dan Teknologi Kementerian Pendidikan, Kebudayaan, Riset, dan Teknologi (Ditjen DIKTI) for providing the computing resources for this project.
