Views
No views yet
intfloat/multilingual-e5-base.model-v1). The goal is practical French semantic search, reranking, clustering, and similarity while preserving the broad multilingual E5 embedding space as much as possible.1from sentence_transformers import SentenceTransformer
2
3model = SentenceTransformer("AurelPx/e5-multilingual-frenchboost-v1")
4queries = ["query: Quelle est la capitale de la France ?"]
5passages = ["passage: Paris est la capitale de la France."]
6
7query_embeddings = model.encode(queries, normalize_embeddings=True)
8passage_embeddings = model.encode(passages, normalize_embeddings=True)
9scores = query_embeddings @ passage_embeddings.Tintfloat/multilingual-e5-baseMTEB(fra)-safe v2 protocol: one task per isolated process, using bounded variants for the historically crash-prone clustering tasks. These numbers should be read as a transparent development benchmark, not as a final SOTA claim.MTEB(fra)-safe v2 GPU-fp16 conservative-lora| category | score | n_tasks |
|---|---|---|
| Classification | 0.6384 | 6 |
| STS | 0.7423 | 3 |
| Reranking | 0.7681 | 2 |
| PairClass. | 0.5538 | 1 |
| Clustering | 0.4402 | 7 |
| Retrieval | 0.5062 | 5 |
| Summarization | 0.3294 | 1 |
| task | v1_score | reference_score | delta |
|---|---|---|---|
| SyntecRetrieval | 0.8231 | 0.3292 | 0.4939 |
| BSARDRetrieval | 0.5856 | 0.1622 | 0.4234 |
| SyntecReranking | 0.8525 | 0.5442 | 0.3083 |
| MasakhaNEWSClusteringS2S | 0.5543 | 0.2479 | 0.3064 |
| AlloprofRetrieval | 0.3558 | 0.0557 | 0.3001 |
| AlloprofReranking | 0.6837 | 0.5077 | 0.1760 |
| AlloProfClusteringP2P | 0.6263 | 0.4635 | 0.1628 |
| XPQARetrieval | 0.4571 | 0.3401 | 0.1170 |
| SummEvalFr | 0.3294 | 0.2921 | 0.0373 |
| STS22 | 0.6485 | 0.6187 | 0.0298 |
| MTOPDomainClassification | 0.8266 | 0.8025 | 0.0241 |
| MassiveScenarioClassification | 0.6710 | 0.6482 | 0.0228 |
