This is dataset is a modified version of "psmathur's" Mini orca dataset, formated in the alpaca format and uncencored.
For ALPACA LORA users:
Modules you can target with lora:"gate_proj", "down_proj", "up_proj", "q_proj", "v_proj", "k_proj", "o_proj"
Most lora models use:"q_proj", "v_proj", "k_proj", "o_proj"
Platypus which got terrific results: "gate_proj", "down_proj", "up_proj"
Research on targeting certain modules still needs to be done, but if you don't want to train over a previously… See the full description on the dataset page:
https://huggingface.co/datasets/Vezora/Mini_Orca_Uncencored_Alpaca.
