Full merged checkpoint (base + LoRA fused, bf16 safetensors, ~8.5 GB) of kurisu-lora-v1.1-qwen3.5-4b. Use this when you want a single deployable model with no PEFT dependency — e.g. GGUF conversion for llama.cpp/Ollama, vLLM without LoRA support, or 8-bit serving on consumer GPUs.


Base	Qwen/Qwen3.5-4B
Precision	bf16 (quantize to taste)
Eval loss	1.756 (adapter's best checkpoint)

Serving on an 8 GB GPU (RTX 2080-class)

8-bit with transformers + bitsandbytes (~4.5 GB weights):

python

import transformers
from transformers import AutoTokenizer, AutoConfig, BitsAndBytesConfig

MODEL = "div2percent/kurisu-v1.1-qwen3.5-4b-merged"
cfg = AutoConfig.from_pretrained(MODEL, trust_remote_code=True)
cls = getattr(transformers, cfg.architectures[0])
tok = AutoTokenizer.from_pretrained(MODEL, trust_remote_code=True)
model = cls.from_pretrained(
    MODEL, device_map="auto", trust_remote_code=True,
    quantization_config=BitsAndBytesConfig(load_in_8bit=True))

Or convert to GGUF Q4_K_M (~2.6 GB) with llama.cpp's convert_hf_to_gguf.py and serve with llama-server / Ollama.

Prompting contract (ChatML, [HH:MM] bubbles, [[sticker:ref]] markers) matches the 27B card — see kurisu-lora-v1.1-qwen3.6-27b.