Buddy is PersonnnOS's local language model. It is tuned for conversational
assistance, tool use and desktop workflows in Spanish and English.
This repository contains the Q4_K_M GGUF build for local inference with
PersonnnOS, llama.cpp or Ollama.
🐼 Give Buddy a body. This is just the brain. PersonnnOS is the sovereign
desktop app where Buddy lives: a native browser, workspace, tools and agent —
all on your machine, no cloud account required. It installs and runs this
model for you with its bundled llama.cpp runtime.
Download personnn-buddy-9b-v2-Q4_K_M.gguf from this repository. PersonnnOS
can install and run it with its bundled llama.cpp runtime, without Ollama or a
cloud account.
Keep Modelfile and the GGUF in the same directory, then run:
bash
1ollama create personnn-buddy:9b-v2 -f Modelfile
2ollama run personnn-buddy:9b-v2
The included Modelfile defines the intended Buddy identity, context length and
sampling defaults.
Evaluation
Buddy v2 scored 11/12 (92%) in PersonnnOS's internal workflow evaluation,
with an average first-token latency of 6.9 seconds on the test machine.
The suite covers chat, structured tool selection and desktop tasks. These
results are internal product measurements, not a general-purpose benchmark.
Intended use
Local conversational assistance.
PersonnnOS tools and desktop workflows.
Spanish-first personal productivity.
Private on-device inference when run through a local runtime.
The model does not itself enforce permissions. PersonnnOS places tool calls
behind its permission broker and requires confirmation for consequential
actions.
Limitations
The model can hallucinate or select an incorrect tool.
Tool availability and schemas are supplied by the host application.
Outputs are not professional legal, medical or financial advice.
External, destructive or irreversible actions should require explicit user
confirmation.
Local privacy depends on the runtime and application configuration. Using a
cloud-hosted runtime sends prompts to that service.
Provenance
Personnn Buddy 9B is derived from
Ornith-1.0-9B, published
by deepreinforce-ai under the MIT license. See THIRD_PARTY_NOTICES.md.
About PersonnnOS
PersonnnOS is a privacy-first personal agent and browser. Learn more at
personnn.com.