You can deploy this model and start earning money today!

Thox-ai/
thox-micro-125m-GGUF

Name: thox-micro-125m-GGUF
Availability: InStock

Thox-ai/thox-micro-125m

quantized

apache-2.0

endpoints_compatible

Views

No views yet

thox-micro-125m-GGUF

Your AI. Your Data. Your Rules.

GGUF builds (Q4_0 → F16) of the from-scratch thox-micro-125m for llama.cpp / on-device.

What this is

Quantized from Thox-ai/thox-micro-125m (Apache-2.0).
Q4_0 is usable because FFN 2048 is divisible by 32 (unlike the 327M).
SHA256SUMS.txt included for verification.

Intended use

On-device / edge text generation within the THOX stack. Not a safety-aligned public assistant unless deployed behind THOX guardrails.

Usage

llama.cpp

bash

huggingface-cli download Thox-ai/thox-micro-125m-GGUF --include '*.gguf' --local-dir ./thox-micro-125m-GGUF
llama-cli -m ./thox-micro-125m-GGUF/model-Q4_0.gguf -p "Hello"

Thox-ai/thox-micro-125m-GGUF

thox-micro-125m-GGUF

What this is

Intended use

Usage

Links

Thox-ai/
thox-micro-125m-GGUF