Lizzy-7B-8bits-MLX – AI Model by AlphaOxO | AlphaNeural AI

You can deploy this model and start earning money today!

AlphaOxO/
Lizzy-7B-8bits-MLX

like

0

text-generation

flwrlabs/Lizzy-7B

Views

No views yet

Lizzy-7B-8bits-mlx

Introduce

Quant by mlx-lm 0.31.3 with new pipeline for lizzy model_type

Usage

mlx_lm.generate mlx_lm.generate --model /path/to/model --prompt "What is different between CPU and GPU?" --max-tokens 2048 --trust-remote-code
# or
mlx_lm.chat --model /path/to/model --max-tokens 2048 --trust-remote-code