You can deploy this model and start earning money today!

danbev/
hailo-qwen-2.5-GGUF

Name: hailo-qwen-2.5-GGUF
Availability: InStock

Views

No views yet

hailo-qwen-2.5 Model Card

Description

This is an experimental GGUF model for Hailo hailo-qwen-2.5 in llama.cpp.

Usage

You can use this model with the following branch: hailo.

Clone and build:

console

$ git clone -b hailo https://github.com/danbev/llama.cpp.git && cd llama.cpp
$ cmake -B build -S . -DGGML_HAILO=ON -DGGML_NATIVE=ON
$ cmake --build build --target llama-cli -j 12

Run:

$ ./build/bin/llama-cli -hf danbev/hailo-qwen-2.5-GGUF