Beta

Explore
Marketplace
Neural Labs
Playground
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

Nanbeige-4.1-3B-Instruct-GGUF – AI Model by tobleron900 | AlphaNeural AI

You can deploy this model and start earning money today!

tobleron900/
Nanbeige-4.1-3B-Instruct-GGUF

like

0

endpoints_compatible

Views

No views yet

Nanbeige-4.1-3B-Instruct GGUF (Q6_K)

This repository contains the GGUF (Q6_K) quantization of the Nanbeige-4.1-3B-Instruct model, optimized for use with llama.cpp.

Quantization Details

The quantization was performed using llama.cpp with an importance matrix (imatrix) for better preservation of model quality.

Method: Q6_K (6-bit quantization)
Importance Matrix: Generated from a calibration dataset for improved performance compared to standard quantization.
Base Model: Nanbeige-4.1-3B-Instruct

Files Included

Nanbeige-4.1-3B-Q6_K-imatrix.gguf: The quantized model file.
Nanbeige-4.1-3B.imatrix: The importance matrix used during quantization.
Nanbeige-4.1-3B-Q6_K-imatrix.gguf.sha256sum: SHA256 checksum for verification.

How to use

You can run this model using llama.cpp or other compatible interfaces.

Example CLI usage:

./llama-cli -m Nanbeige-4.1-3B-Q6_K-imatrix.gguf -n 512 --prompt "Hello, how are you today?"

Reproducibility

The importance matrix (Nanbeige-4.1-3B.imatrix) is provided so you can recreate or refine the quantization process.