Views
No views yet
<think>...</think> blocks before answering.| Base model | Tess-4-27B (Qwen3.5-VL / Qwen3_5ForConditionalGeneration arch, ~27B params, vision + video capable) |
| Quantization | MX FP4 (micro-scaled 4-bit float) |
| Bits per weight | 4.449 |
| Disk size | 14 GB (from ~52 GB bf16) |
| Format | MLX (safetensors) |
| Minimum unified memory | Runs comfortably on 24GB+ unified memory Macs. Smoke-tested on an Apple M4 Pro (24GB) — loads and generates coherent, on-topic output. |
1from mlx_vlm import load, generate
2from mlx_vlm.prompt_utils import apply_chat_template
3from mlx_vlm.utils import load_config
4
5model_path = "sahilchachra/tess-4-27b-mxfp4-mlx"
6model, processor = load(model_path, trust_remote_code=True)
7config = load_config(model_path, trust_remote_code=True)
8
9prompt = apply_chat_template(processor, config, "Explain the difference between TCP and UDP.", num_images=0)
10out = generate(model, processor, prompt, image=None, max_tokens=1024, verbose=False)
11print(out.text if hasattr(out, "text") else out)num_images=1 in apply_chat_template, and pass the image to generate(..., image=<path_or_url>).1mlx_vlm.generate --model sahilchachra/tess-4-27b-mxfp4-mlx \
2 --prompt "Explain the difference between TCP and UDP." \
3 --max-tokens 1024<think>...</think> reasoning blocks — allow a generous max_tokens budget (1024+) so generation doesn't cut off mid-thought.mlx_vlm.generate (text-only, image=None) with the model's Qwen3.5-family chat template, on an Apple M4 Pro (24GB unified memory):Prompt: "Explain the difference between TCP and UDP in two sentences."
Output: Here's a thinking process:
1. **Analyze User Input:**
- **Topic:** TCP vs UDP
- **Constraint:** Explain the difference in exactly two sentences.
2. **Identify Key Differences:**
- TCP (Transmission Control Protocol): Connection-oriented, reliable, guarantees delivery, ordered, error-checked, slower due to overhead.
- UDP ...Prompt: "Write a haiku about the ocean at night."
Output: Thinking Process:
1. **Analyze the Request:**
- Topic: Ocean at night.
- Form: Haiku (5-7-5 syllable structure).
2. **Brainstorming Imagery & Keywords:**
- Visuals: Moon, stars, reflection, dark water, waves, foam, bioluminescence ...max_tokens=80 mid-reasoning (this is a thinking-native model — allow a much larger max_tokens budget, e.g. 1024+, to reach the final <think>...</think> answer). Quantization preserves the model's signature deliberate, step-by-step reasoning style intact.