You can deploy this model and start earning money today!

zeuxcg/
llama3-8b-calm

Name: llama3-8b-calm
Availability: InStock

Views

No views yet

After downloading both .calm files and the run binary, run:

chmod a+x run

and then:

./run llama3-8b-fp8.calm -i "?" -n 32 -r 5
CALM_POSO=4000 ./run llama3-8b-fp8.calm -i "?" -n 32 -r 5
./run llama3-8b-gf4.calm -i "?" -n 32 -r 5
CALM_POSO=4000 ./run llama3-8b-gf4.calm -i "?" -n 32 -r 5

Note: the run binary is not signed, so macOS will refuse to run it by default, but you can ctrl+click the binary and press "Open", which will show a dialog where you need to press "Open" again. After this the binary should be fine to run from terminal.

If you'd rather build the binary yourself, you can do it like this:

git clone https://github.com/zeux/calm
make -C calm

... but you'll need Xcode installed for this to work.

zeuxcg/llama3-8b-calm

zeuxcg/
llama3-8b-calm