MOST Embed DE — German customer-support retrieval model, with query: / passage: prompts and normalized 2048-d embeddings.
Cosine similarity vs the upstream sentence-transformers reference on a fixed
test set (text):
The fine-tune is distributed under
CC-BY-NC-4.0; commercial use is not permitted without separate authorization from the fine-tune author. It is derived from NVIDIA's
Nemotron-3-Embed-1B-BF16, whose Model Materials are distributed under
OpenMDW-1.1. Redistribution must retain the OpenMDW agreement plus all applicable copyright and origin notices. Both sets of terms and the upstream model cards must be reviewed and preserved.
1# Download
2huggingface-cli download cstr/most-embed-de-GGUF most-embed-de-q4_k-attn-q8.gguf --local-dir .
3
4# Run with CrispEmbed
5./crispembed -m most-embed-de-q4_k-attn-q8.gguf "Hello world"
6
7# Or with auto-download
8./crispembed -m most-embed-de "Hello world"
Compared with the original Transformers implementation. F16 reaches cosine 1.000000 at every dumped transformer boundary and on the final embedding. Q8_0 reaches final cosine 0.999818. The compact Q4_K artifact keeps token embeddings and attention at Q8_0; over eight German query/document texts it has minimum cosine 0.987191, preserves every top-1 retrieval result, and reduces maximum similarity-score error to 0.02595.
CrispEmbed is a lightweight C/C++ text embedding inference engine using ggml.
No Python runtime, no ONNX. Supports BERT, XLM-R, Qwen3, and Gemma3 architectures.
1# Build CrispEmbed
2git clone https://github.com/CrispStrobe/CrispEmbed
3cd CrispEmbed
4cmake -S . -B build && cmake --build build -j
5
6# Encode
7./build/crispembed -m most-embed-de-q4_k-attn-q8.gguf "query text"
8
9# Server mode
10./build/crispembed-server -m most-embed-de-q4_k-attn-q8.gguf --port 8080
11curl -X POST http://localhost:8080/v1/embeddings \
12 -d '{"input": ["Hello world"], "model": "most-embed-de"}'