This repository hosts a mirrored, app-ready model pack for Vesper’s Offline Assistant.
It contains a quantized GGUF version of:
Model: Qwen2.5-0.5B-Instruct
Format: GGUF
Quantization: Q4_K_M
This model is used only for local interpretation (intent + slot extraction) inside the Vesper app.
It does NOT perform financial calculations or direct data access.
🔧 Usage (Vesper)
The Vesper app will:
Fetch manifest.json
Compare versions
Download the model if needed
Verify checksum
Run locally via a GGUF runtime (e.g., llama.cpp)
This model is downloaded on-demand by users as the “Offline Assistant Pack”.
📦 Files
models/qwen2.5-0.5b-instruct-q4.gguf — quantized model