configs: - config_name: raw data_files: raw/pharma_paragraph_process.jsonl - config_name: instruction data_files: instruction/pharma_instruction_dataset.jsonl - config_name: preference data_files: preference/pharma_preference_dataset.jsonl
Pharma Fine-Tuning Data
Three datasets used across the 3-stage fine-tuning pipeline in
llm-finetuning-playbook:
raw: cleaned paragraphs extracted from the pharma PDF (Stage 1 — continued pretraining)… See the full description on the dataset page:
https://huggingface.co/datasets/SivaSai8143/pharma-finetuning-data.
