The Agriculture-QA Tokenized Dataset is a high-performance, ready-to-train version of the original agriculture-qa dataset. It has been specifically optimized for Large Language Models (LLMs) like Gemma, LLaMA, and Mistral.
It contains 25,410 high-quality question-answer pairs transformed into instruction-style sequences and pre-tokenized for causal language modeling ($CLM$). This removes the… See the full description on the dataset page: https://huggingface.co/datasets/atidu/agriculture-qa-tokenized.
