Bond is a first-person character-voice fine-tune of Mistral-Small-3.1-24B-Instruct: it holds a committed in-character first-person voice instead of leaking back to helpful-assistant mode. Uncensored, explicit-capable. Eval, training, and the design goal are on the base model card.

This quant

Essentially indistinguishable from bf16. Wants ~32GB+ unified memory.

Other MLX sizes: 4-bit, 6-bit. (4-bit smallest, 6-bit near-lossless, 8-bit lossless.)

Use

python

from mlx_lm import load, generate

model, tok = load("darthcrawl/bond-mlx-8bit")
prompt = tok.apply_chat_template(
    [{"role": "user", "content": "Tell me about the worst night of your life."}],
    add_generation_prompt=True,
)
print(generate(model, tok, prompt=prompt, max_tokens=512, verbose=True))

Or the CLI: mlx_lm.generate --model darthcrawl/bond-mlx-8bit --prompt "...".

darthcrawl/Bond-24B-v1.0-mlx-8bit

Bond v1 — first-person character voice (MLX 8-bit)

This quant

Use

darthcrawl/
Bond-24B-v1.0-mlx-8bit