You can deploy this model and start earning money today!

TimeSurgeLabs/
zephyr-7b-beta-llamafile

Name: zephyr-7b-beta-llamafile
Availability: InStock

llamafile

apache-2.0

Views

No views yet

Zephyr 7B Beta Llamafiles

See here for a guide on how to use llamafiles!

Original Model: Zephyr 7B Beta
Quantized Model: Zephyr 7B Beta GGUF
Llamafile Source Code: Mozilla-Ocho/llamafile
- Built with Llamafile 5ea929c

Both the server and the CLI are based on TheBloke's Zephyr 7B Beta GGUF Q4_K_M model.

Usage

NOTE: Due to the executable being greater than 4GB, it is currently not compatible with Windows. I will update with a Windows friendly version of Zephyr 7B Beta when I can.

bash

# replace with the CLI if you prefer
wget https://huggingface.co/TimeSurgeLabs/zephyr-7b-beta-llamafile/resolve/main/zephyr-beta-server.llamafile
chmod +x zephyr-beta-server.llamafile
./zephyr-beta-server.llamafile