You can deploy this model and start earning money today!

lainlives/
ZAYA1-8B-GGUF

Name: ZAYA1-8B-GGUF
Availability: InStock

Views

No views yet

lainlives/ZAYA1-8B-GGUF

This model contains GGUF format model files for Zyphra/ZAYA1-8B.

The following files were generated and uploaded to this repo: Q4_K, Q5_K, Q6_K, Q8_0, f16, bf16

CLI:

llama-cli --hf-repo lainlives/ZAYA1-8B-GGUF --hf-file ZAYA1-8B-Q4_K_M.gguf -p "The meaning to life and the universe is"

Server:

llama-server --hf-repo lainlives/ZAYA1-8B-GGUF --hf-file ZAYA1-8B-Q4_K_M.gguf -c 2048

CLI:

ollama run https://hf.co/lainlives/ZAYA1-8B-GGUF:Q4_K_M