Views
No views yet
nvidia/Cosmos-Reason2-2B, a 2.4B vision-language model post-trained from Qwen3-VL-2B-Instruct for physical-AI reasoning, spatial understanding, anomaly detection, and chain-of-thought scene analysis.| File | Size | Notes |
|---|---|---|
Cosmos-Reason2-2B-Q4_K_M.gguf | ~1.28 GB | 4-bit k-quant. Recommended for memory-constrained devices (e.g., iPhone 13+, 6 GB RAM). |
Cosmos-Reason2-2B-Q8_0.gguf | ~2.10 GB | 8-bit quant. Recommended where memory allows (iPhone 15 Pro+ / 8 GB+). |
mmproj-Cosmos-Reason2-2B-F16.gguf | ~0.82 GB | Vision projector. Required for multimodal inference; load alongside either quant. |
1llama-server \
2 -m Cosmos-Reason2-2B-Q4_K_M.gguf \
3 --mmproj mmproj-Cosmos-Reason2-2B-F16.gguf \
4 --host 0.0.0.0 --port 8080 \
5 -c 4096 --jinjahttp://localhost:8080/v1. Standard chat/completions with image_url content blocks works out of the box.nvidia/Cosmos-Reason2-2B) on a golden eval covering spatial reasoning, scene understanding, counting, OCR, anomaly detection, bounding-box output, and refusal. Q4_K_M scores 6/7 — equivalent to MLX Q4 — with the single discrepancy being an evaluator heuristic artifact, not a real quality regression.Kbenkhaled/Cosmos-Reason2-2B-GGUF for hosting stability under the hzang/ account, alongside the MLX variants:hzang/Cosmos-Reason2-2B-4bit — MLX 4-bit (1.78 GB)hzang/Cosmos-Reason2-2B-8bit — MLX 8-bit (2.64 GB)hzang/Cosmos-Reason2-2B-GGUF — llama.cpp GGUF (this repo)