Views
No views yet
Yoctotta-Technologies/firetower-qwen3.5-0.8b fine-tune, ready for llama.cpp / llama-server deployment.| File | Size | Bits/weight | Use |
|---|---|---|---|
firetower-qwen3.5-0.8b-q4_k_m.gguf | 529 MB | 5.51 | Recommended for production. Best size/quality trade. |
firetower-qwen3.5-0.8b-f16.gguf | 1.51 GB | 16.0 | Lossless reference. Quantize on-device if you want a different format. |
1docker run --rm --gpus all -p 8080:8080 \
2 -v $PWD:/models \
3 ghcr.io/ggml-org/llama.cpp:server-cuda \
4 -m /models/firetower-qwen3.5-0.8b-q4_k_m.gguf \
5 -ngl 999 --host 0.0.0.0 --port 8080 --jinja --reasoning off --ctx-size 4096-hf to pull this repo directly:1docker run --rm --gpus all -p 8080:8080 \
2 ghcr.io/ggml-org/llama.cpp:server-cuda \
3 -hf Yoctotta-Technologies/firetower-qwen3.5-0.8b-gguf:Q4_K_M \
4 -ngl 999 --host 0.0.0.0 --port 8080 --jinja --reasoning off --ctx-size 40961curl http://127.0.0.1:8080/v1/chat/completions \
2 -H "Content-Type: application/json" \
3 -d '{
4 "model": "vlm",
5 "messages": [{
6 "role": "user",
7 "content": [
8 {"type": "image_url", "image_url": {"url": "data:image/jpeg;base64,..."}},
9 {"type": "text", "text": "You are analyzing a forest fire tower camera image. ..."}
10 ]
11 }],
12 "response_format": {"type": "json_object"},
13 "max_tokens": 300, "temperature": 0.1
14 }'1{
2 "smoke": 0.7, "haze": 0.2, "fire": 0.8, "normal": 0.0,
3 "ground_anchored": true, "base_visible": true,
4 "reasoning": "..."
5}| Verdict acc | Fire recall | Fires missed | |
|---|---|---|---|
| Base Qwen3.5-0.8B (Q4_K_M) | 72.0 % | 0 % | 14 / 14 |
| This model (Q4_K_M) | 74.1 % | 77.9 % | 15 / 68 |
Yoctotta-Technologies/firetower-qwen3.5-0.8b for complete training and limitations details.