You can deploy this model and start earning money today!

thlurte/
bge-small-en-v1.5-GGUF

Name: bge-small-en-v1.5-GGUF
Availability: InStock

Views

No views yet

bge-small-en-v1.5-GGUF

This repository contains GGUF format model files for BAAI/bge-small-en-v1.5, generated with llama.cpp's conversion tools.

These files are fully compatible with llama.cpp and intextus.

bge-small-en-v1.5-F32.gguf: Full precision F32.
bge-small-en-v1.5-F16.gguf: Half precision F16.
bge-small-en-v1.5-Q8_0.gguf: 8-bit quantization (recommended default, fast and near-lossless).
bge-small-en-v1.5-Q6_K.gguf: 6-bit quantization.
bge-small-en-v1.5-Q5_K_M.gguf: 5-bit quantization (Medium).
bge-small-en-v1.5-Q5_0.gguf: 5-bit quantization.
bge-small-en-v1.5-Q4_K_M.gguf: 4-bit quantization (Medium).
bge-small-en-v1.5-Q4_0.gguf: 4-bit quantization.
bge-small-en-v1.5-Q3_K_M.gguf: 3-bit quantization (Medium).
bge-small-en-v1.5-Q2_K.gguf: 2-bit quantization.