You can deploy this model and start earning money today!

vocaela/
Vocaela-2-500M-1024R2-GGUF

Name: Vocaela-2-500M-1024R2-GGUF
Availability: InStock

gguf

image-text-to-text

vocaela/Vocaela-2-500M-1024R2

Views

No views yet

Vocaela-2-500M-1024R2-GGUF

This repo contains GGUF-format weights for Vocaela-2-500M-1024R2, containing:

Language model (LLM): Q8_0
Vision encoder (mmproj): Q8_0

Note: So far LlamaCpp has problem on rendering chat template correctly. To workaround it, we apply chat template (e.g., using python / node.js etc.) before calling llama-server endpoint. For examples of how to use it, please refer to repo vocaela-500m-demo

vocaela/Vocaela-2-500M-1024R2-GGUF

Vocaela-2-500M-1024R2-GGUF

vocaela/
Vocaela-2-500M-1024R2-GGUF