You can deploy this model and start earning money today!

Ziyaad30/
umt5-xxl-encoder-gguf

Name: umt5-xxl-encoder-gguf
Availability: InStock

gguf

Able2/umt5-xxl-encode-only

quantized

apache-2.0

endpoints_compatible

Views

No views yet

umt5-xxl gguf model with encoder only, mainly used as text encoder for image or video generation models. Use with llama.cpp.

Example command:

llama-embedding -m umt5-xxl-encode-only-Q4_K_M.gguf -p "Penguin" --pooling none --embd-normalize -1 --no-warmup --batch-size 512 --ctx-size 512 --embd-output-format array

Ziyaad30/umt5-xxl-encoder-gguf

Ziyaad30/
umt5-xxl-encoder-gguf