Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

gemma-4-26b-A4B-it-assistant-gguf – AI Model by RachidAR | AlphaNeural AI

You can deploy this model and start earning money today!

RachidAR/
gemma-4-26b-A4B-it-assistant-gguf

like

0

google/gemma-4-26B-A4B-it-assistant

endpoints_compatible

Views

No views yet

Gemma 4 26B A4B Assistant GGUF

GGUF quantizations converted from google/gemma-4-26B-A4B-it-assistant.

Tested with llama.cpp b9549 (Gemma 4 MTP support).

Recommendations

IQ4_NL — best overall balance (for limited vram)
Q5_K_M — recommended if VRAM allows
Q6_K / Q8_0 — highest precision options

Files

gemma-4-26B-A4B-it-assistant-bf16.gguf
gemma-4-26b-A4B-it-assistant-IQ4_NL.gguf
gemma-4-26b-A4B-it-assistant-Q4_0.gguf
gemma-4-26b-A4B-it-assistant-Q4_K_M.gguf
gemma-4-26b-A4B-it-assistant-Q5_K_M.gguf
gemma-4-26b-A4B-it-assistant-Q6_K.gguf
gemma-4-26b-A4B-it-assistant-Q8_0.gguf

Example

bash

llama-server \
  -m gemma-4-26B-A4B-it-UD-Q5_K_XL.gguf \
  -md gemma-4-26b-A4B-it-assistant-IQ4_NL.gguf \
  --spec-type draft-mtp \
  --spec-draft-n-max 2

Recommended values:

--spec-draft-n-max 2 for general use
--spec-draft-n-max 3 for coding workloads (up to 4 if highly repetitive)