SentenceTransformer based on BAAI/bge-m3

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: BAAI/bge-m3
• Maximum Sequence Length: 768 tokens
• Output Dimensionality: 1024 dimensions
• Similarity Function: Cosine Similarity

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 768, 'do_lower_case': False}) with Transformer model: XLMRobertaModel 
  (1): Pooling({'word_embedding_dimension': 1024, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

Training Details

Training Dataset

Unnamed Dataset

• Size: 11,928 training samples
• Columns: sentence and label
• Approximate statistics based on the first 1000 samples:

  	sentence	label
  type	string	int
  details	min: 71 tokens mean: 335.77 tokens max: 768 tokens	1: ~8.60% 2: ~3.80% 3: ~8.80% 4: ~7.30% 5: ~8.00% 6: ~6.60% 7: ~6.10% 8: ~6.70% 9: ~6.80% 10: ~4.90% 11: ~3.80% 12: ~8.70% 13: ~7.90% 14: ~7.00% 15: ~5.00%

• Samples:

  sentence	label
  to improve the convergence speed and optimization accuracy of the dung beetle optimizer (dbo), this paper proposes an improved algorithm based on circle mapping and longitudinal-horizontal crossover strategy (cicrdbo). first, the circle method is used to map the initial population to increase diversity. second, the longitudinal-horizontal crossover strategy is applied to enhance the global search ability by ensuring the position updates of the dung beetle. simulations were conducted on 10 benchmark test functions, and the results demonstrate that the improved algorithm performs well in both convergence speed and optimization accuracy. the improved algorithm is further applied to the hyperparameter selection of the random forest classification algorithm for binary classification prediction in the retail industry. various combination comparisons prove the practicality of the improved algorithm, followed by shapley additive explanations (shap) analysis.	9
  background minimally invasive concepts are increasingly influential in modern cardiac surgery. this study aimed to evaluate the effect of completeness of revascularization on clinical outcomes and overall survival in minimally invasive, thoracoscopic coronary artery bypass grafting (cabg) surgery. methods we retrospectively evaluated a consecutive series of 1,149 patients who underwent minimally invasive off-pump cabg with single, double, or triple-vessel revascularization between 2007 and 2018. of these patients, 185 (16.1%) had incomplete revascularization (ir) (group i), and 964 (83.9%) had complete revascularization (cr) (group c). we used gradient boosted propensity score estimation to account for possible confounding variables. results median age was 69 years, interquartile range (iqr) 60–76 years, and median euroscore ii was 4, iqr 2–7. of the 1,149 patients, 495 patients suffered from two vessel disease (vd) and 353 presented with three vd. long-term median follow-up 5.58 (3.27...	11
  setiap tahunnya perguruan tinggi melakukan penerimaan mahasiswa baru secara rutin untuk membuka awal tahun ajaran baru. namun tingginya jumlah mahasiswa yang mengundurkan diri menyebabkan banyaknya jumlah kursi kosong yang tersisa. pengunduran diri yang terjadi bisa diminimalisir apabila seleksi calon mahasiswa baru dilakukan dengan tepat. salah satu caranya dengan membuat model prediksi berbasis machine learning untuk membantu proses seleksi kandidat yang berpotensi menyelesaikan proses penerimaan hingga akhir berdasarkan data yang ada. agar hal tersebut bisa tercapai, dibuatlah model prediksi menggunakan algoritma adaboost sekaligus membandingkan performanya dengan model alogoritma decision tree. untuk memaksimalkan peforma model, maka dilakukan analisa variabel dengan menggunakan chi square dalam proses feature selection- nya. hasil akhir menunjukkan bahwa model prediksi adaboost memiliki peforma yang lebih baik daripada model decision tree dengan skor f-measure 90.9%, precision 83....	8

• Loss: BatchHardSoftMarginTripletLoss

Evaluation Dataset

Unnamed Dataset

• Size: 2,983 evaluation samples
• Columns: sentence and label
• Approximate statistics based on the first 1000 samples:

  	sentence	label
  type	string	int
  details	min: 33 tokens mean: 347.09 tokens max: 768 tokens	1: ~9.50% 2: ~3.10% 3: ~7.50% 4: ~9.10% 5: ~7.60% 6: ~7.10% 7: ~7.60% 8: ~6.80% 9: ~5.50% 10: ~4.30% 11: ~3.40% 12: ~7.40% 13: ~6.20% 14: ~9.90% 15: ~5.00%

• Samples:

  sentence	label
  kemiskinan adalah berbeda-beda dan merefleksikan suatu spektrum orientasi ideologi. faktor yang mempengaruhi tingkat kemiskinan adalah pertumbuhan ekonomi. jadi kemiskinan tidak lagi sekedar masalah kekurangan makanan saja. pertumbuhan keseluruh sektor usaha sangat dibutuhkan dalam upaya menurunkan tingkat kemiskinan. untuk menangani dan berkoordinasi dalam hal-hal yang berkaitan dengan penanggulangan kemiskinan, maka perlu mengklasifikasikan usia dan jenis kelamin dari individu dengan tingkat kesejahteraan 30% terbawah. seiring dengan perkembangan teknologi yang begitu pesat, perkembangan algoritma komputer sedang mengembangkan beberapa algoritma untuk mendukung kemajuan sistem komputerisasi. algoritma yang terkenal diantaranya adalah algoritma decision tree (c4.5), random tree, linear and quadratic discriminant analysis, neural network, least square support vector machines, k-nn, random forest, cart, dan naive bayes.	5
  the quantitative data of logistic demand are the important basis for regional logistic development policy and planning,there are many factors influencing logistic demand,so traditional forecast method can not overall consider all kinds of factors and has lower forecast accuracy.in order to improve the forecast accuracy of logistic demand,combined forecast method is used to set up the combined forecast model based on support vector machines and neural network,firstly support vector machines are used to forecast and forecast basic data are obtained,then residual modification is conducted by bp neural network,and numerical example simulation analysis indicates that the combined forecast model has higher accuracy,is a kind of effective forecast model and provides a new idea for logistic demand forecast.	5
  this paper discusses the problem of cultural identity for learners of french who have inherited an educational system introduced by the colonizers. the historical experience of the caribbean has resulted in a critical and significant difference between what we really are and what we have become by the process. if our african heritage lies at the centre of our cultural identity it gives meaning to the strategies and positioning that can be used in an educational process that acknowledges the “doubleness” of similarity and difference in the constant process of “becoming”. if english can be considered the first foreign language by the majority of the people of the african diaspora, french is a second foreign language, in which learners are stretched linguistically and culturally at the same time. the natural dramatic propensities of blacks have an important position of play in the complexity of doubleness.	2

• Loss: BatchHardSoftMarginTripletLoss

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: epoch
• num_train_epochs: 5
• warmup_ratio: 0.1
• bf16: True

All Hyperparameters

Training Logs

Framework Versions

• Python: 3.12.3
• Sentence Transformers: 4.1.0
• Transformers: 4.53.0
• PyTorch: 2.6.0+cu126
• Accelerate: 1.8.1
• Datasets: 3.6.0
• Tokenizers: 0.21.2

Citation

BibTeX

Sentence Transformers

BatchHardSoftMarginTripletLoss