Views
No views yet
{"result": "corrected text"}, nothing else.<think> block
that matches the fine-tune's training rendering. Consumers do not need to
pass enable_thinking=False; the flag is ignored.generation_config.json lists both stop ids (<|im_end|>,
<|endoftext|>); generation terminates correctly out of the box.| Model | Exact match | Avg CER | Semantic sim | Latency* | Disk |
|---|---|---|---|---|---|
| Yooz-Quality v3 (this repo) | 27.0% | 0.1307 | 0.9442 | 1,226 ms | 3.42 GB |
| Yooz-Light v3 (0.8B) | 21.1% | 0.1738 | 0.9335 | 341 ms | 0.61 GB |
| Qwen3.5-9B-8bit (reference) | 18.5% | 0.1695 | 0.9363 | 2,427 ms | 10.43 GB |
1from mlx_lm import load, generate
2from mlx_lm.sample_utils import make_sampler
3
4model, tokenizer = load("YoozLabs/Yooz-Quality-v3-Qwen3.5-4B")
5
6prompt = tokenizer.apply_chat_template(
7 [
8 {
9 "role": "system",
10 "content": (
11 "Rewrite this voice transcription into clear, polished "
12 "text. Remove filler words, fix grammar, and convert "
13 'spoken numbers to digits. Return JSON: '
14 '{"result": "corrected text"}'
15 ),
16 },
17 {
18 "role": "user",
19 "content": "so um i think we should you know prepare for the "
20 "presentation on friday",
21 },
22 ],
23 tokenize=False,
24 add_generation_prompt=True,
25)
26print(generate(model, tokenizer, prompt=prompt, max_tokens=512,
27 sampler=make_sampler(temp=0.0)))
28# {"result": "We should prepare for the presentation on Friday."}temp=0.0) is recommended; the model is trained for
deterministic correction, not creative generation.