You can deploy this model and start earning money today!

noctrex/
UI-Venus-1.5-2B-GGUF

Name: UI-Venus-1.5-2B-GGUF
Availability: InStock

Views

No views yet

These are quantizations of the model UI-Venus-1.5-2B, using a imatrix created from text_en_medium

Usage Notes:

Download the latest llama.cpp to use these quantizations.
Try to use the best quality you can run.
For the mmproj file, the F32 version is recommended for best results (F32 > BF16 > F16).

noctrex/UI-Venus-1.5-2B-GGUF