You can deploy this model and start earning money today!

majentik/
Qwen3-Embedding-0.6B-GGUF-Q5_K_M

Name: Qwen3-Embedding-0.6B-GGUF-Q5_K_M
Availability: InStock

Views

No views yet

Qwen3-Embedding-0.6B GGUF Q5_K_M

llama.cpp GGUF Q5_K_M quantization of Qwen/Qwen3-Embedding-0.6B.

bash

llama-embedding -m qwen3-emb-0.6b-Q5_K_M.gguf \
  -p "What is the capital of France?"

Or via llama-cpp-python:

python

from llama_cpp import Llama
llm = Llama(model_path="qwen3-emb-0.6b-Q5_K_M.gguf", embedding=True)
vec = llm.embed("What is the capital of France?")

Apache 2.0 — inherited from the upstream base model.