You can deploy this model and start earning money today!

playable/
Qwen2.5-Coder-7B-Instruct-iat-03-GGUF

Base Model: Qwen/Qwen2.5-Coder-7B-Instruct
Adapter: iat-03
Quantization: q4_k_m
Format: GGUF

Name: Qwen2.5-Coder-7B-Instruct-iat-03-GGUF
Availability: InStock

Views

No views yet

Qwen2.5-Coder-7B-Instruct-iat-03-GGUF

This is a GGUF quantized version (q4_k_m) of Qwen/Qwen2.5-Coder-7B-Instruct fine-tuned with the 'iat-03' adapter.

This model can be used with llama.cpp or any compatible inference engine that supports GGUF format.

bash

# Example with llama.cpp
./llama-cli -m model_q4_k_m.gguf -p "Your prompt here"