DagMeow/

Velvet-14B-GGUF

Velvet-14B converted to GGUF format (F32) with fbuciuni90/llama.cpp fork and quantized with ggerganov/llama.cpp commit b4689.

NOTE: The Velvet tokenizer is not yet compatible with ggerganov/llama.cpp. Please wait for pull request #11716 to be merged, or compile it yourself.

Original Model: https://huggingface.co/Almawave/Velvet-14B

Basic prompt format:

Prompt format with system message: