qwen2.5-coder-7b-instruct-gguf is a GGUF Q4_K_M int4 quantized version of Qwen2.5-Coder-7B-Instruct, providing a fast inference implementation, optimized for AI PCs.

This is from the latest release series from Qwen, and is an excellent chat/instruct coding assistant model.

Model Description

Developed by: Qwen
Quantized by: llmware
Model type: qwen2.5
Parameters: 7 billion
Model Parent: Qwen/Qwen2.5-Coder-7B-Instruct
Language(s) (NLP): English
License: Apache 2.0
Uses: Chat, general-purpose LLM
Quantization: int4

Model Card Contact

llmware on github

llmware on hf

llmware website

llmware/qwen2.5-7b-coder-gguf

qwen2.5-coder-7b-instruct-gguf

Model Description

Model Card Contact

llmware/
qwen2.5-7b-coder-gguf