qwen_v3_gguf – AI Model by nikhil-singh-iphtech | AlphaNeural AI

You can deploy this model and start earning money today!

nikhil-singh-iphtech/
qwen_v3_gguf

like

0

Qwen/Qwen3-0.6B

endpoints_compatible

Views

No views yet

Qwen3-0.6B mEinstein GGUF

Fine-tuned version of Qwen/Qwen3-0.6B on the mEinstein personal AI assistant dataset.

Available Quantizations

File	Format	Size	Use case
`Qwen_mEinstein_F16.gguf`	F16	~1.2 GB	Highest quality
`Qwen_mEinstein_Q8_0.gguf`	Q8_0	~0.6 GB	Balanced
`Qwen_mEinstein_Q4_K_M.gguf`	Q4_K_M	~0.4 GB	Fastest / lightest

How to Run

./llama-cli -m Qwen_mEinstein_Q4_K_M.gguf -p "Who am I?" -n 256

Training Details

Base model: Qwen/Qwen3-0.6B
Method: QLoRA (4-bit) + SFT
LoRA target modules: q_proj, k_proj, v_proj, o_proj
Dataset: mEinstein personal assistant dataset