Medical Mistral LoRA - Healthcare Q&A Assistant
A Mistral 7B Instruct model fine-tuned with QLoRA on 15,000 medical patient-doctor dialogues.
Model Details
| Component | Detail |
|---|
| Base model | Mistral 7B Instruct v0.3 |
| Method | QLoRA (4-bit NF4 + LoRA rank 32) |
| Dataset | ruslanmv/ai-medical-chatbot (15K samples) |
| Hardware | NVIDIA Tesla T4 (16 GB) |
| Training time | 4.4 hours |
| Peak VRAM | 6.0 GB |
| Final eval loss | 2.274 |
| Trainable params | 83.9M of 7.3B (1.14%) |
Example Responses
Patient: I have persistent lower back pain radiating down my left leg
Doctor: This is a clear case of sciatica. There are many causes like herniated discs and stenosis. You should visit your doctor for examination and MRI scan.
Patient: My 4 year old has a fever of 103F for three days
Doctor: Fever above 102-105F should be treated with paracetamol. Give nutritious food with vitamin C such as orange juice and fruits to boost immunity.
Patient: I have a fungal infection between my toes that keeps coming back
Doctor: Use antifungal medication like fluconazole. Wear breathable shoes and socks, wash feet daily, dry them well. Use powder on foot after bathing.
Disclaimer
This model is for educational and research purposes only. Not a substitute for professional medical advice.
Author
