We have released the new v2-qwen dataset to evaluate performance advantages on large-scale models.
Due to significant hallucination issues in the common subset, the results were not satisfactory.
Additionally, during fine-tuning, LoRA + bitsandbytes 8-bit quantization was employed to accelerate training. The model's efficiency may be compromised compared to fully-precision models.
