How Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resources
Original dataset page from ehartford.
348,020 entries. Sourced from open-instruct-uncensored.jsonl. Uses only these dataset subsets;
Flan V2
CoT
Dolly
OASST1
GPT4-Alpaca
Code-Alpaca
ShareGPT
Converted the jsonl to a json which can be loaded into something like LLaMa-LoRA-Tuner.
Count of each Dataset:
code_alpaca: 19991
oasst1: 49433
flan_v2: 97519
sharegpt: 46733
dolly: 14624
cot: 73946
gpt4_alpaca: 45774
