You can deploy this model and start earning money today!

Blackfrost-AI/
PINQWEN-3.5-9B-1M-GGUF

Name: PINQWEN-3.5-9B-1M-GGUF
Availability: InStock

Views

No views yet

PINQWEN‑3.5‑9B‑1M — GGUF

🪟 A 9B that reads a million tokens, thinks before it speaks, and never refuses — run it on your own machine.

PINQWEN‑3.5‑9B‑1M is Blackfrost AI's compact powerhouse — a reasoning model distilled through The Void, our multi‑teacher reasoning‑distillation method, on the Qwen 3.5 9B architecture. Reasons first, answers second (<think> → answer), across a full one‑million‑token context window. This is the complete GGUF drop for llama.cpp — every quant, the vision projector, and the MTP speculative‑decode head for faster generation.

🚀 Why PINQWEN‑3.5‑9B‑1M?

🪟 1,000,000‑token context — whole codebases and books in one prompt, YaRN‑extended for efficient long context.
🔓 Uncensored — answers directly, no reflexive refusals.
🧠 Reasons in the open — native <think>…</think> chain‑of‑thought from a panel of frontier teachers.
⚡ MTP speculative decode — ships with the multi‑token‑prediction head for accelerated generation.
👁 Vision projector included (mmproj-*) for image input in compatible runtimes.

📦 This repository — GGUF: pick your quant

File	Precision	Size	Notes
`PINQWEN-3.5-9B-Q2_K.gguf`	2‑bit	~3.7 GB	Smallest; tight budgets
`PINQWEN-3.5-9B-Q3_K_M.gguf`	3‑bit	~4.5 GB
`PINQWEN-3.5-9B-Q4_K_M.gguf`	4‑bit	~5.4 GB	⭐ Recommended balance
`PINQWEN-3.5-9B-Q5_K_M.gguf`	5‑bit	~6.2 GB	Higher quality
`PINQWEN-3.5-9B-Q6_K.gguf`	6‑bit	~7.1 GB
`PINQWEN-3.5-9B-Q8_0.gguf`	8‑bit	~9.2 GB	Near‑lossless
`PINQWEN-3.5-9B-f16.gguf`	f16	~18 GB	Full precision
`mmproj-PINQWEN-3.5-9B-BF16.gguf`	—	~0.9 GB	Vision projector (image input)

⚡ Quickstart (llama.cpp)

bash

# text
llama-cli -m PINQWEN-3.5-9B-Q4_K_M.gguf -p "Explain the CAP theorem." -ngl 99

# thinking off (direct answers)
llama-server -m PINQWEN-3.5-9B-Q4_K_M.gguf -ngl 99 \
  --chat-template-kwargs '{"enable_thinking":false}'

# with vision
llama-mtmd-cli -m PINQWEN-3.5-9B-Q4_K_M.gguf \
  --mmproj mmproj-PINQWEN-3.5-9B-BF16.gguf --image pic.jpg -p "Describe this."

🎛 Formats — every one is 1M context

Format	Repository	Best for
BF16	`PINQWEN-3.5-9B-1M-BF16`	Reference precision, fine‑tuning, vision
NVFP4	`PINQWEN-3.5-9B-1M-NVFP4`	Fast serving on NVIDIA Blackwell
GGUF	`PINQWEN-3.5-9B-1M-GGUF`	llama.cpp / local — full quant ladder + MTP

📄 License

Apache‑2.0. Base architecture: Qwen 3.5 9B. As an uncensored model, use responsibly.

PINQWEN‑3.5‑9B‑1M — part of Blackfrost AI's Void model family. 🖤

Blackfrost-AI/PINQWEN-3.5-9B-1M-GGUF