You can deploy this model and start earning money today!

MedDocAI/
Qwen3-4B-Instruct-2507-GGUF

Name: Qwen3-4B-Instruct-2507-GGUF
Availability: InStock

Qwen/Qwen3-4B-Instruct-2507

Views

No views yet

Qwen3-4B-Instruct-2507 — Q6_K GGUF

A Q6_K GGUF quantization of Qwen/Qwen3-4B-Instruct-2507, prepared by MedDoc AI for on-device (iOS, llama.cpp + Metal) clinical-note generation.

This is the base instruct model (no fine-tune). In MedDoc AI it is the Phase-2 on-device writer: tooth/identity facts are owned by a deterministic guard, and the base model owns fluency.

Provenance

Source weights: Qwen/Qwen3-4B-Instruct-2507 (snapshot cdbee75f17c01a7cc42f958dc650907174af0554), Apache-2.0.
Converted to F16 GGUF with llama.cpp convert_hf_to_gguf.py, then quantized to Q6_K with llama-quantize.
6.56 BPW. File size: 3,306,259,520 bytes.
SHA-256: 1d00455bad14002ca127aef1c8fb2c1fc6718930efb6229a7766e01989eec174

License & NOTICE

Licensed under the Apache License 2.0, inherited from the base model. Copyright the Qwen team (Alibaba Cloud). This repository redistributes a quantized derivative; all rights and obligations of the Apache-2.0 license apply. No model weights were modified beyond quantization.

MedDocAI/Qwen3-4B-Instruct-2507-GGUF

Qwen3-4B-Instruct-2507 — Q6_K GGUF

Provenance

License & NOTICE

MedDocAI/
Qwen3-4B-Instruct-2507-GGUF