Files: model-00001-of-00011.safetensors through model-00011-of-00011.safetensors, plus tokenizer/config files
Approximate directory size: 48 GB
Use this option for Transformers/PEFT-style local loading or downstream conversion workflows.

Local usage

bash

llama-cli \
  -m swarm-sovereign-26b-Q4_K_M.gguf \
  -ngl 99 \
  -c 4096 \
  --jinja \
  -p "What is your name? Answer in one sentence."

Import or download the GGUF in LM Studio, then load it as a local model. The local test identifier used during release validation was:

swarm-sovereign-26b

Validation

Local validation on Apple Silicon / LM Studio:

text

Prompt: What is your name? Answer in one sentence.
Answer: My name is Swarm Sovereign.

LM Studio memory estimate at 4096 context with full GPU offload:

text

Estimated GPU Memory:   16.44 GiB
Estimated Total Memory: 16.44 GiB

Want to build and manage an entire private swarm of agents all with shared memory, skills, and single setup?

This model is intended for local experimentation and private agent workflows. Test thoroughly for your use case before deploying in production.