Beta

Explore
Marketplace
Neural Labs
Playground
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

Gemmagguf – AI Model by AFZAL0008 | AlphaNeural AI

You can deploy this model and start earning money today!

AFZAL0008/
Gemmagguf

like

0

vision-language-model

endpoints_compatible

Views

No views yet

Gemmagguf : GGUF

This model was finetuned and converted to GGUF format using Unsloth.

Example usage:

For text only LLMs: llama-cli -hf AFZAL0008/Gemmagguf --jinja
For multimodal models: llama-mtmd-cli -hf AFZAL0008/Gemmagguf --jinja

Available Model files:

medgemma-4b-it.Q8_0.gguf
medgemma-4b-it.F16-mmproj.gguf

⚠️ Ollama Note for Vision Models

Important: Ollama currently does not support separate mmproj files for vision models.

To create an Ollama model from this vision model:

Place the Modelfile in the same directory as the finetuned bf16 merged model
Run: ollama create model_name -f ./Modelfile (Replace model_name with your desired name)

This will create a unified bf16 model that Ollama can use.

Note

The model's BOS token behavior was adjusted for GGUF compatibility. This was trained 2x faster with Unsloth