homebot-qwen3.5-4b-gguf – AI Model by kanakjr | AlphaNeural AI

You can deploy this model and start earning money today!

kanakjr/
homebot-qwen3.5-4b-gguf

like

0

text-generation

kanakjr/homebot-qwen3.5-4b-gguf-merged16

endpoints_compatible

Views

No views yet

homebot-qwen3_5-4b

HomeBot qwen3.5 4B fine-tune exported to GGUF for local Ollama inference.

Built by finetuning/finalize_gguf_colab.ipynb from the merged fp16 weights at kanakjr/homebot-qwen3.5-4b-gguf-merged16.

Available quantizations

Quant	Approx. size	Recommended for
Q4_K_M	smallest	< 8 GB RAM machines
Q5_K_M		good balance
Q6_K		~1-2% quality gap vs. fp16
Q8_0	largest	> 16 GB RAM -- default for M-series Macs

Quick start on a Mac

bash

hf download kanakjr/homebot-qwen3.5-4b-gguf --include "*.Q8_0.gguf" --include "*.Modelfile" --local-dir ~/homebot-model
cd ~/homebot-model
ollama create homebot-qwen3_5-4b -f homebot-qwen3_5-4b.Modelfile
ollama run homebot-qwen3_5-4b "turn off the air purifier"

See finetuning/README.md in the HomeBot repo for the full pipeline.