Views
No views yet
| Property | Value |
|---|---|
| Parameters | 230M |
| Precision | 6-bit |
| Group Size | 64 |
| Size | 178 MB |
| Context Length | 128K |
pip install mlx-lm1from mlx_lm import load, generate
2from mlx_lm.sample_utils import make_sampler
3
4model, tokenizer = load("LiquidAI/LFM2.5-230M-MLX-6bit")
5
6response = generate(
7 model,
8 tokenizer,
9 prompt="The capital of France is",
10 max_tokens=100,
11 sampler=make_sampler(temp=0.7),
12 verbose=True,
13)