Views
No views yet
| Property | Value |
|---|---|
| Parameters | 350M |
| Precision | 8-bit |
| Group Size | 64 |
| Size | 381 MB |
| Context Length | 128K |
pip install mlx-lm1from mlx_lm import load, generate
2from mlx_lm.sample_utils import make_sampler
3
4model, tokenizer = load("LiquidAI/LFM2.5-350M-MLX-8bit")
5
6response = generate(
7 model,
8 tokenizer,
9 prompt="The capital of France is",
10 max_tokens=100,
11 sampler=make_sampler(temp=0.7),
12 verbose=True,
13)