Views
No views yet
llama.cpp or Python llama-cpp-python library.llama.cpp's convert-hf-to-gguf.py script.llama.cpp.llama-cpp-python library. Here's an example:1from llama import Model
2
3# Load the converted model
4model = Model.load("rbehzadan/bge-large-en-v1.5-ggml-f16")
5
6# Encode some text
7text = "This is a sample sentence."
8encoded_text = model.embed(text)llama-cpp-python library installed for this model to function.