mzbac/
mlx-yayi2-30b-guanaco-4-bit

Name: mlx-yayi2-30b-guanaco-4-bit
Availability: InStock

Views

No views yet

Run it using the MlX framework. For more details, click here.

python yayi.py --model-path <path_to_mlx_model> --prompt "### Human: 你好\n### Assistant:"

Prompt template:

### Human: {prompt}
### Assistant:

mzbac/mlx-yayi2-30b-guanaco-4-bit