Model Summary
This repository hosts quantized versions of the Qwen2.5-7B-Instruct model.
Format: GGUF
Converter: llama.cpp 70392f1f81470607ba3afef04aa56c9f65587664
Quantizer: LM-Kit.NET 2024.8.4
For more detailed information on the base model, please visit the following link:
