MechBot
A QLoRA fine-tune of Qwen3.5-4B on mechanical engineering data including arXiv papers and textbooks.
Specialized for engineering calculations, formulas, and technical Q&A.
Training
- Base: Qwen/Qwen3.5-4B
- Method: QLoRA (4-bit, r=8)
- Dataset: 10,169 samples from arXiv papers and mechanical engineering textbooks
- Hardware: NVIDIA H100 80GB (CSU Cashew HPC)
