You can deploy this model and start earning money today!

WarlordHermes/
QwenLong-30B-creative-ORPO-v3-Q4_K_M-GGUF

Name: QwenLong-30B-creative-ORPO-v3-Q4_K_M-GGUF
Availability: InStock

Views

No views yet

WarlordHermes/QwenLong-30B-creative-ORPO-v3-Q4_K_M-GGUF

This model was converted to GGUF format from WarlordHermes/QwenLong-30B-creative-ORPO-v3 using llama.cpp via Convert Model to GGUF.

Key Features:

Refer to the original model card for more details on the base model.

1. Install llama.cpp:

brew install llama.cpp # For macOS/Linux

2. Run Inference:

CLI:

llama-cli --hf-repo WarlordHermes/QwenLong-30B-creative-ORPO-v3-Q4_K_M-GGUF --hf-file qwenlong-30b-creative-orpo-v3-q4_k_m.gguf -p "Your prompt here"

Server:

llama-server --hf-repo WarlordHermes/QwenLong-30B-creative-ORPO-v3-Q4_K_M-GGUF --hf-file qwenlong-30b-creative-orpo-v3-q4_k_m.gguf -c 2048

For more advanced usage, refer to the llama.cpp repository.