Views
No views yet
mistral-7B-v0.1 weights in npz format suitable for use with Apple's MLX framework.1pip install mlx
2pip install huggingface_hub hf_transfer
3git clone https://github.com/ml-explore/mlx-examples.git
4cd mlx-examples
5
6# Download model
7export HF_HUB_ENABLE_HF_TRANSFER=1
8huggingface-cli download --local-dir-use-symlinks False --local-dir mistral-7B-v0.1 mlx-community/mistral-7B-v0.1
9
10# Run example
11python llms/mistral/mistral.py --prompt "My name is"