This repository provides
EXAONE 3.5 2.4B Instruct compiled and optimized for Mobilint NPU hardware, packaged for use with
llama.cpp-mblt.
1# Simple decoding
2llama-cli-mblt -hf mobilint/EXAONE-3.5-2.4B-Instruct-GGUF -p "Hello!" -n 128
3
4# EAGLE3 speculative decoding
5llama-cli-mblt -hf mobilint/EXAONE-3.5-2.4B-Instruct-GGUF --eagle3 -p "Hello!" -n 128
6
7# Interactive chat
8llama-cli-mblt -hf mobilint/EXAONE-3.5-2.4B-Instruct-GGUF --eagle3
This model is compiled and optimized for
Mobilint NPU hardware. It is intended to be used with
llama-cli-mblt from
llama.cpp-mblt.