Views
No views yet
ZygAI is a base engine, not a chatbot persona.
Behavior and specialization are applied at runtime (OpenWebUI / API).
llama.cpp| Quantization | Purpose | Notes |
|---|---|---|
| Q4_K_M | Fast | Best speed, low memory |
| Q5_K_M | Balanced | Default general use |
| Q8_0 | High quality | Best reasoning, higher RAM |
Models may be provided as GGUF shards (-00001-of-00002.gguf).
llama.cpploads shards automatically — no merge required.
./llama-server \
-m ZygAI-q4_k_m-00001-of-00002.gguf \
--host 0.0.0.0 \
--port 8081 \
--ctx-size 4096 \
--threads 4 \
--batch-size 2048 \
--jinja| Model | Port |
|---|---|
| Q4 | 8081 |
| Q5 | 8082 |
| Q8 | 8083 |
http://127.0.0.1:PORT/v1Examples:
User (EN):
> What is Lithuania?
Assistant:
> Lithuania is a country located in the Baltic region of Eastern Europe.
User (LT):
> Kada Lietuva įstojo į Europos Sąjungą?.
Assistant:
> Lietuva įstojo į Europos Sąjungą 2004 m. gegužės 1 d.@software{zygai-7b,
title = {ZygAI: Neutral Bilingual AI Engine for Lithuanian and English},
author = {Mažeika, Žygimantas},
year = {2025},
publisher = {Hugging Face},
url = {https://huggingface.co/ZygAI},
license = {Apache-2.0},
note = {Local-first GGUF models optimized for llama.cpp with runtime personas}
}