Views
No views yet
llama.cpp. You can test it using the
following adapted version:1git clone https://github.com/piDack/llama.cpp -b support_glm_edge_model
2cmake -B build -DGGML_CUDA=ON # Or enable other acceleration hardware
3cmake --build build -- -j llama-cli -m <path>/model.gguf -p "<|user|>\nhi<|assistant|>\n" -ngl 999