This represents the PEFT weights only.
The base model is LLaMA 2.
Instruction finetuning was done using 4 bit QLoRA on a single A100 GPU with the PEFT config as given below.
The dataset used for this instruction finetuning process is a translated version of the cleaned alpaca dataset (translated using NLLB-1.3B).
Do note that this model might have inferior performance on some language specific tasks compared to full finetuning
or a different base model trained with more language specific data.
library_name: peft
Training procedure
The following bitsandbytes quantization config was used during training:
