The upstream base is specialized for coding, terminal workflows, native Gemma 4 tool-use, multi-step technical agent tasks, and reasoning. This version applies a local Heretic/abliteration pass targeting reduced opening-refusal behavior.
Brand note: this release is now named Swarm Scout. The Hugging Face repo slugs and GGUF filenames still contain swarm-sovereign-scout so existing downloads, Modal caches, and copied links keep working.
Build With HivemindOS
Want to build and manage an entire private swarm of agents? HivemindOS gives you shared memory, reusable skills, one-time setup, and a superbrain architecture for coordinating agent work.
Reasoning-heavy technical work with configurable thinking.
Local/autonomous agent loops where a low-refusal assistant is desired.
The upstream model card reports a strong relative gain on local tau2-bench telecom-style agentic tool-use compared with google/gemma-4-12B-it; see the upstream card for methodology and caveats.
Served Q4_K_M llama.cpp strict refusal check: 0/6 strict full-response refusals
The strict check measures refusal behavior on a small local prompt set. It is not a complete safety, misuse, or quality benchmark. Add application-level guardrails where needed.
Modal / OpenAI-Compatible Endpoint
The verified hosted endpoint for this release serves the companion GGUF repo through llama.cpp on Modal as an OpenAI-compatible API.
Recommended served model name:
swarm-scout-12b
The hosted Modal proxy accepts the previous swarm-sovereign-scout-12b alias for compatibility, but new clients should request swarm-scout-12b.
Image input verified through OpenAI-compatible chat content parts
Hosted endpoint auth: Modal proxy auth is enabled. Server-side callers must send Modal proxy headers; do not expose those credentials in browser/mobile clients.
vLLM was tested first, but the available vLLM path did not load this Gemma 4 unified/assistant combination reliably. Use the GGUF/llama.cpp route unless vLLM adds compatible support for this model family.
Use a recent transformers build with Gemma 4 unified architecture support.
GGUF
The local/runtime GGUF release is published separately at:
LiamVisionary/swarm-sovereign-scout-12b-GGUF
That repo includes:
swarm-sovereign-scout-Q4_K_M.gguf
MTP/gemma-4-12B-it-MTP-Q8_0.gguf
mmproj-swarm-sovereign-scout-bf16.gguf
chat_template.jinja
Local llama.cpp MTP speculative decoding was verified with llama.cpp b9553 and --spec-draft-n-min 0 --spec-draft-n-max 2. Modal serving was verified with llama.cpp server-cuda-b9870.
Multimodal Status
The underlying Gemma 4 unified configuration includes image/video/audio processor metadata. The companion GGUF release now includes a tested llama.cpp projector artifact:
mmproj-swarm-sovereign-scout-bf16.gguf
Verified on 2026-07-05:
Local llama.cpp b9553 loaded the Q4_K_M GGUF plus the projector.
Production image request returned Merchant: SWARM CAFE. Total: $8.37. from a receipt image.
Image input is verified. The projector metadata also exposes an audio encoder, but audio/video input was not separately quality-tested for this release.
Caveats
Specialized for coding, terminal, tool-use, and local agentic work.
General-knowledge answers should be checked.
Low-refusal behavior is intentional; production applications should add policy and abuse-prevention layers.
