The .q8 file runs with the hipfire inference engine (HIP/ROCm-direct, Rust,
no Python in the hot path). It is not GGUF/safetensors and won't load in
llama.cpp / transformers. All weights are stored at Q8 and dequantized to f32
on the fly inside the GEMV kernels.
Files
File
Quant
Size
lfm2.5-1.2b-instruct.q8
Q8 (all tensors)
1.25 GB
The LiquidAI chat template is embedded in the file and used by default
(jinja chat is default-on in hipfire; opt out with HIPFIRE_JINJA_CHAT=0).
Usage (hipfire)
# hipfire CLI (registry tag, once available in your hipfire version):
hipfire pull lfm2.5:1.2b
hipfire run lfm2.5:1.2b "What is the capital of France?"
# or download directly and point at the file:
hf download hipfire-models/hipfire-LFM2.5-1.2B lfm2.5-1.2b-instruct.q8 --local-dir ~/.hipfire/models
hipfire serve --model ~/.hipfire/models/lfm2.5-1.2b-instruct.q8
