This is a regenerated model that combines the base model Mistral-7B-v0.1 with the LoRA model
Mistral-7B-OpenOrca-lora.
This LoRA model is extracted from the efficient parameter fine-tuned model (
Mistral-7B-OpenOra), and now it needs to be verified whether this LoRA model can achieve comparable performance with the original model.
The final goal is to create a toolkit that can simultaneously load multiple LoRA modules, and automatically switch to the appropriate combination of LoRA modules based on user queries to generate the best answer.