Views
No views yet
BAAI/bge-m3
weights, in safetensors format. BAAI publishes bge-m3 only as an fp32
pytorch_model.bin (a PyTorch pickle); this repo exists so that Rust/candle consumers
(and anyone else) can load the model via memory-mapped safetensors at half the size,
with no pickle parsing and no fp32→f16 conversion transient at load time.tensor.to(torch.float16) applied to the canonical fp32 weights.
config.json and tokenizer.json are byte-identical copies from the source revision.| Source | BAAI/bge-m3, revision 5617a9f61b028005a4858fdac845db406aefb181 |
| Source file | pytorch_model.bin, 2,271,145,830 B, sha256 b5e0ce3470abf5ef3831aa1bd5553b486803e83251590ab7ff35a117cf6aad38 (verified before conversion) |
| Tokenizer | tokenizer.json, sha256 21106b6d7dab2952c1d496fb21d5dc9db75c28ed361a05f5020bbba27810dd08 (unmodified copy) |
| Conversion | 391/391 tensors cast fp32 → f16 (torch 2.12.0, safetensors), zero tensors altered otherwise |
| Verification | after writing, every tensor reloaded and bitwise-compared against a fresh f16 cast of the source — 391/391 identical |
| Output | model.safetensors, 1,135,554,344 B, sha256 68440cc1b73b9af8ab85ecdc138b51877493ffbcec92a0a16e5d7e518eb22908 |
1let vb = VarBuilder::from_mmaped_safetensors(&["model.safetensors"], DType::F16, &device)?;
2// BGE-M3 is XLM-RoBERTa-large; CLS-pool the last hidden state, then L2-normalize.
3// Pad token id is 1 (from config.json) — not 0.BAAI/bge-m3. All credit for
the model belongs to BAAI / the FlagEmbedding team.