Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

harrier-oss-v1-0.6b-GGUF-Q8_0 – AI Model by majentik | AlphaNeural AI

You can deploy this model and start earning money today!

majentik/
harrier-oss-v1-0.6b-GGUF-Q8_0

like

0

sentence-similarity

feature-extraction

microsoft/harrier-oss-v1-0.6b

endpoints_compatible

Views

No views yet

[!TIP] KV-cache quantization (upstream, no fork needed): llama.cpp/Ollama cover this natively — -ctk q8_0 -ctv q8_0 (~half KV memory, negligible quality loss) or -ctk q4_0 -ctv q4_0 (~quarter memory, small quality cost). In Ollama: OLLAMA_KV_CACHE_TYPE=q8_0 with OLLAMA_FLASH_ATTENTION=1.

harrier-oss-v1-0.6b GGUF Q8_0

llama.cpp GGUF Q8_0 quantization of microsoft/harrier-oss-v1-0.6b.

Produced with: llama-quantize (upstream llama.cpp)
BF16 source via convert_hf_to_gguf.py
Quant type: Q8_0
File size: 610 MB

Quickstart

llama-embedding -m harrier-0.6b-Q8_0.gguf -p "What is Harrier-OSS?"

License

MIT — inherited from the upstream Harrier-OSS-v1-0.6B.

See also

Base: microsoft/harrier-oss-v1-0.6b
Garden hub: majentik/garden
llama.cpp: https://github.com/ggml-org/llama.cpp