homebot-qwen3.5-2b-gguf – AI Model by kanakjr | AlphaNeural AI

You can deploy this model and start earning money today!

kanakjr/
homebot-qwen3.5-2b-gguf

like

0

text-generation

kanakjr/homebot-qwen3.5-2b-gguf-merged16

endpoints_compatible

Views

No views yet

homebot-qwen3_5-2b

HomeBot qwen3.5 2B fine-tune exported to GGUF for local Ollama inference.

Built by finetuning/finalize_gguf_colab.ipynb from the merged fp16 weights at kanakjr/homebot-qwen3.5-2b-gguf-merged16.

Available quantizations

Quant	Approx. size	Recommended for
Q4_K_M	smallest	< 8 GB RAM machines
Q5_K_M		good balance
Q6_K		~1-2% quality gap vs. fp16
Q8_0	largest	> 16 GB RAM -- default for M-series Macs

Quick start on a Mac

bash

hf download kanakjr/homebot-qwen3.5-2b-gguf --include "*.Q8_0.gguf" --include "*.Modelfile" --local-dir ~/homebot-model
cd ~/homebot-model
ollama create homebot-qwen3_5-2b -f homebot-qwen3_5-2b.Modelfile
ollama run homebot-qwen3_5-2b "turn off the air purifier"

See finetuning/README.md in the HomeBot repo for the full pipeline.