SentenceTransformer based on microsoft/mpnet-base

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: microsoft/mpnet-base
• Maximum Sequence Length: 512 tokens
• Output Dimensionality: 768 dimensions
• Similarity Function: Cosine Similarity
• Training Dataset:
  • json

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False, 'architecture': 'PeftModelForFeatureExtraction'})
  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
)

Usage

Direct Usage (Sentence Transformers)

Evaluation

Metrics

Triplet

• Datasets: initial_test and final_test
• Evaluated with TripletEvaluator

Training Details

Training Dataset

json

• Dataset: json
• Size: 800 training samples
• Columns: anchor, positive, and negative
• Approximate statistics based on the first 800 samples:

  	anchor	positive	negative
  type	string	string	string
  details	min: 7 tokens mean: 16.79 tokens max: 39 tokens	min: 39 tokens mean: 117.74 tokens max: 265 tokens	min: 40 tokens mean: 116.14 tokens max: 356 tokens

• Samples:

  anchor	positive	negative
  What is the limitation of FBG-based sensors in tactile feedback?	Furthermore, FBG-based 3-axis tactile sensors have been[object Object]proposed for a more comprehensive haptic perception tool[object Object]in surgeries (Figure 1D) (16). Five optical fibers merged[object Object]with FBG sensors are suspended in a deformable medium[object Object]and measure the compression or tension of the tissue as the[object Object]sensors are pressed against it, returning a _ surface[object Object]reaction map. While FBG-based sensors are small, flexible, and[object Object]sensitive, there are several challenges that need to be[object Object]addressed for optimal performance for tactile feedback. These[object Object]sensors are temperature sensitive, requiring temperature	141]. Therefore, it is not known to what extent spared[object Object]axons are remyelinated by transplanted Schwann cells,[object Object]nor is the contribution of this myelin to functional im-[object Object]provements proven. Transplantation of Schwann cells[object Object]incapable of producing myelin, such as cells derived[object Object]from trembler (Pmp22Tr) mutant mice, may be useful[object Object]in establishing a causal relationship between myelin re-[object Object]generation and functional improvements. Several MSC[object Object]transplantations demonstrate an increase of myelin re-[object Object]tention and the number of myelinated axons in the le-[object Object]sion site during a chronic post-injury period [57]. Thus,
  What are the advantages of strain elastography?	frontiersin.org[object Object][object Object]--- Page 8 ---[object Object]Kumar et al.[object Object][object Object]TABLE 2 Modalities of ultrasound elastography.[object Object][object Object]Modality[object Object]Strain elastography[object Object][object Object]Excitation[object Object]Applied manual compression (38)[object Object][object Object]Advantages[object Object][object Object]No additional specialized equipment[object Object]required (40)[object Object][object Object]10.3389/fmedt.2023.1238129[object Object][object Object]Limitations[object Object][object Object]Qualitative measurements (39)[object Object][object Object]Internal physiological mechanism (42)[object Object][object Object]Simple low-cost design (40)[object Object][object Object]Applied compression is operator-dependent (51)[object Object][object Object]More commonly used (52)[object Object][object Object]High inter-observer variability (51)[object Object][object Object]coustic radiation force impulse Acoustic radiation force (43)[object Object][object Object](ARFI) imaging[object Object][object Object]Image beyond slip boundaries (45)	Publisher’s Note: MDPI stays neutral[object Object]with regard to jurisdictional claims in[object Object]published maps and institutional afil-[object Object][object Object]iations.[object Object][object Object]onon)[object Object][object Object]Copyright: © 2021 by the author.[object Object]Licensee MDPI, Basel, Switzerland.[object Object]This article is an open access article[object Object]distributed under the terms and[object Object]conditions of the Creative Commons[object Object]Attribution (CC BY) license (https://[object Object]creativecommons.org/licenses/by/[object Object]4.0/).[object Object][object Object]Joan and Sanford I. Weill Department of Medicine, Weill Cornell Medical College, 525 East 68th Street,[object Object]Room M-522, Box 130, New York, NY 10065, USA; [object Object] or [object Object]
  What is the material used for the substrate in a piezoelectric element?	gain for biomedical applications.[object Object][object Object]frontiersin.org[object Object][object Object]--- Page 9 ---[object Object]Kumar et al.[object Object][object Object]>[object Object][object Object][PMUT ][object Object][object Object]Electrode: Voltage Electrode2[object Object][object Object]© piezoelectric elements[object Object]o[object Object][object Object]—: OSi02[object Object][object Object]©) silicon substrate[object Object][object Object]B [ CMUT ][object Object]AC DC[object Object][object Object]membrane[object Object][object Object]—————[object Object][object Object]vacuum[object Object]insulator[object Object][object Object]substrate[object Object][object Object]= ground[object Object][object Object]FIGURE 3	Histopatholo[object Object]Cytology Total, n (%) Benign, n (%) P ey Cancer, n (%)[object Object]FA 2 (15.4%) FTC 2 (25%)[object Object]0 GD (7.7%) PTC 6 (75%)[object Object]I 21 (4.0%) NG 9 (69.2%)[object Object]Other diagnosis (7.7%)[object Object]FA 15 (9.9%) FIC 4 (14.3%)[object Object]FT-UMP (0.7%) MTC 3 (10.7%)[object Object]GD (0.7%) PTC 21 (75%)[object Object]Il 180 (34.5%) OA (0.7%)[object Object]LT (0.7%)[object Object]NG 130 (85.5%)[object Object]NIFTP 2 (1.3%)[object Object]FA 14 (23.7%) FIC 7 (28.0%)[object Object]FI-UMP 2 (3.4%) OTC 1 (4.0%)[object Object]OA (1.7%) PTC 17 (68.0%)[object Object]Il 84 (16.1%) LT 3 (5.1%)[object Object]NG 35 (59.3%)[object Object]NIFTP 2 (3.4%)[object Object]WDT-UMP 2 (3.4%)[object Object]FA 15 (26.3%) OTC 1 (7.7%)[object Object]FT-UMP 5 (8.8%) PTC 12 (92.3%)[object Object]OA 13 (22.8%)[object Object]IV 70 (13.4%) LT 2 (3.5%)[object Object]NG 18 (31.6%)[object Object]NIFTP 2 (3.5%)

• Loss: MultipleNegativesRankingLoss with these parameters:
  json

  1{ 2 "scale": 20.0, 3 "similarity_fct": "cos_sim" 4}

Evaluation Dataset

json

• Dataset: json
• Size: 200 evaluation samples
• Columns: anchor, positive, and negative
• Approximate statistics based on the first 200 samples:

  	anchor	positive	negative
  type	string	string	string
  details	min: 7 tokens mean: 17.14 tokens max: 35 tokens	min: 40 tokens mean: 121.3 tokens max: 356 tokens	min: 45 tokens mean: 119.75 tokens max: 356 tokens

• Samples:

  anchor	positive	negative
  What can differentiate into a very wide variety of tissues?	lead to decreased rates of graft-versus-host disease. They[object Object]also can differentiate into a very wide variety of tissues. For[object Object]example, when compared with bone marrow stem cells or[object Object]mobilized peripheral blood, umbilical cord blood stem cells[object Object]have a greater repopulating ability.5° Cord blood derived[object Object]CD34+ cells have very potent hematopoietic abilities, and[object Object]this is attributed to the immaturity of the stem cells rela-[object Object]tive to adult derived cells. Studies have been done that an-[object Object]alyze long term survival of children with hematologic dis-[object Object]orders who were transplanted with umbilical cord blood	metabolic regulation may affect the function of more than one organelle. Therefore, if the[object Object]miR-17-92 regulatory cluster can perturb genes related to mitochondrial metabolic function,[object Object]it could be also related, in some way, to genes involved in lysosomal metabolic function.[object Object]Lysosomes are intracellular organelles that, in form of small vesicles, participate in[object Object]several cellular functions, mainly digestion, but also vesicle trafficking, autophagy, nutrient[object Object]sensing, cellular growth, signaling [85], and even enzyme secretion. The membrane-bound
  What are the two most common types of pluripotent stem cells?	III]. AMNIOTIC CELLS AS A SOURCE FOR STEM[object Object]CELLS[object Object][object Object]Historically, the two most common types of pluripotent[object Object]stem cells include embryonic stem cells (ESCs) and induced[object Object]pluripotent stem cells (iPSCs).35 However, despite the many[object Object]research efforts to improve ESC and iPSC technologies,[object Object]there are still enormous clinical challenges.°> Two signif-[object Object]icant issues posed by ESC and iPSC technologies include[object Object]low survival rate of transplanted cells and tumorigenicity.°>[object Object]Recently, researchers have isolated pluripotent stem cells	Explanation: criterion 6 indicates a positive diagnosis only within the DC VI group[object Object]relative to all other categories. Criterion 5 indicates a positive diagnosis within the DCs VI[object Object]and V relative to all other categories.[object Object][object Object]The highest positive predictive value (PPV) confirming malignancy through histopatho-[object Object]logical examination for criterion 6 was 0.93, and for criterion 5, it was 0.92. For the subsequent[object Object]criteria, the PPVs were as follows: criterion 4—0.66; criterion 3—0.55; criterion 2—0.40.
  What percentage of stem cells are present in bone marrow?	ing 30% in some tissues.43-45 This is a significant difference[object Object]from the .0001-.0002% stem cells present in bone marrow.43[object Object]Given this difference in stem cell concentration between[object Object]the sources, there will be more ADSCs per sample of WAT	migration of bCSCs. This finding raises the possibil-[object Object]ity that LIPUS may decrease the ability of these cells to[object Object]invade adjacent tissues and start the process of metasta-[object Object]ses. These results also suggested that some of the changes[object Object]induced by LIPUS take longer to be detected in this type[object Object]of 2D migration model, possible due to changes in gene[object Object]expression pattern. To further study this hypothesis, we[object Object]performed a Transwell invasion assay. The data revealed[object Object]a reduced number of cells crossing the membrane after[object Object]LIPUS stimulation, indicating that therapeutic LIPUS

• Loss: MultipleNegativesRankingLoss with these parameters:
  json

  1{ 2 "scale": 20.0, 3 "similarity_fct": "cos_sim" 4}

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: steps
• per_device_train_batch_size: 16
• per_device_eval_batch_size: 16
• warmup_ratio: 0.1
• fp16: True
• batch_sampler: no_duplicates

All Hyperparameters

Training Logs

Framework Versions

• Python: 3.11.11
• Sentence Transformers: 5.0.0
• Transformers: 4.51.3
• PyTorch: 2.6.0+cu124
• Accelerate: 1.5.2
• Datasets: 3.6.0
• Tokenizers: 0.21.1

Citation

BibTeX

Sentence Transformers

MultipleNegativesRankingLoss