This model is fine-tuned from the
llama2-13b-chat base model with an SFT QA dataset generated from
The Elements book.
The fine-tuned model has a good understanding and proper focus on chemistry terms, making it a good model for RAG applications for chemistry subjects.
The base model is quantized to Q5_K_M and then fined-tuned with the generated QA dataset. The LORA layers are then applied back to the base model. The fine-tuned model has the same number of parameters, quantization, and prompt template as the base model.
