This repository contains GGUF conversions of Firefly-v4, a multimodal fine-tune based on p-e-w/gemma-4-E2B-it-heretic-ara.

These files are intended for local inference with GGUF-compatible software such as:

Original model: https://huggingface.co/Guilherme34/Firefly-v4

This GGUF release includes experimental MTP support.

I was not originally planning to spend much time on Firefly-v4's GGUF release, but many people have enjoyed using the model. Because of that, I decided to give this repository the attention it deserves and polish it properly.

That said, I still personally consider Firefly-v3 to be my best model overall. Everyone has different preferences, though, and I am happy to continue supporting Firefly-v4 for those who enjoy it.

Thank you to everyone who has shared feedback and supported the project.

Original Model: Firefly-v4
Author: Guilherme34

Base Model: p-e-w/gemma-4-E2B-it-heretic-ara

This repository contains only GGUF conversions. All credit for the model training, fine-tuning, datasets, and original work belongs to the original author.

This repository is distributed under the Firefly-v4 Attribution License.

Commercial use, quantizations, merges, and derivative works are permitted under the terms described in the included LICENSE file.

Please preserve the required attribution when redistributing or building upon this model.

This model is uncensored and will generate content without built-in refusals. It is intended for creative fiction and roleplay between consenting adults. The creator is not responsible for how the model is used. Do not use it to produce content that is illegal in your jurisdiction.