You can deploy this model and start earning money today!

danbev/
hailo-llama-3.2-GGUF

Name: hailo-llama-3.2-GGUF
Rating: 2.5 (22 reviews)

Views

No views yet

hailo-llama-3.2 Model Card

Description

This is an experimental GGUF model for Hailo hailo-llama-3.2 in llama.cpp.

Usage

You can use this model with the following branch: hailo.

Clone and build:

console

$ git clone -b hailo https://github.com/danbev/llama.cpp.git && cd llama.cpp
$ cmake -B build -S . -DGGML_HAILO=ON -DGGML_NATIVE=ON
$ cmake --build build --target llama-cli -j 12

Run:

$ ./build/bin/llama-cli -hf danbev/hailo-llama-3.2-GGUF