Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

mosaic-extra – Dataset by malaysia-ai | AlphaNeural AI

You can deploy this model and start earning money today!

malaysia-ai/
mosaic-extra

like

0

Views

No views yet

Mosaic format for extra dataset to train Malaysian LLM

This repository is to store dataset shards using mosaic format.

prepared at https://github.com/malaysia-ai/dedup-text-dataset/blob/main/pretrain-llm/combine-extra.ipynb using tokenizer https://huggingface.co/malaysia-ai/bpe-tokenizer 4096 context length.

how-to

git clone,

git lfs clone https://huggingface.co/datasets/malaysia-ai/mosaic-extra

load it,

from streaming import LocalDataset import numpy as np… See the full description on the dataset page: https://huggingface.co/datasets/malaysia-ai/mosaic-extra.