SentenceTransformer based on sentence-transformers/all-MiniLM-L6-v2

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: sentence-transformers/all-MiniLM-L6-v2
• Maximum Sequence Length: 256 tokens
• Output Dimensionality: 384 dimensions
• Similarity Function: Cosine Similarity

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 256, 'do_lower_case': False}) with Transformer model: BertModel 
  (1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

Training Details

Training Dataset

Unnamed Dataset

• Size: 2,000 training samples
• Columns: sentence_0, sentence_1, and label
• Approximate statistics based on the first 1000 samples:

  	sentence_0	sentence_1	label
  type	string	string	float
  details	min: 7 tokens mean: 15.1 tokens max: 39 tokens	min: 12 tokens mean: 166.48 tokens max: 256 tokens	min: 0.0 mean: 0.51 max: 1.0

• Samples:

  sentence_0	sentence_1	label
  What is (are) Psoriasis ?	How might Fanconi Bickel syndrome be treated? Management of Fanconi Bickel syndrome (FBS) generally focuses on the signs and symptoms of the condition. Treatment includes replacement of water and electrolytes, and vitamin D and phosphate supplements for prevention of hypophosphatemic rickets. Although there is limited data on the effectiveness of dietary treatment for this condition, it is recommended that affected individuals follow a galactose-restricted diabetic diet, with fructose as the main source of carbohydrate. Diet and supplements may alleviate some of the signs and symptoms of the condition but generally do not improve growth, resulting in short stature in adulthood.	0.0
  Is Adenoid cystic carcinoma inherited ?	What are the signs and symptoms of Kaufman oculocerebrofacial syndrome? The Human Phenotype Ontology provides the following list of signs and symptoms for Kaufman oculocerebrofacial syndrome. If the information is available, the table below includes how often the symptom is seen in people with this condition. You can use the MedlinePlus Medical Dictionary to look up the definitions for these medical terms. Signs and Symptoms Approximate number of patients (when available) Abnormality of calvarial morphology 90% Arachnodactyly 90% Cognitive impairment 90% Long toe 90% Microcephaly 90% Optic atrophy 90% Respiratory insufficiency 90% Upslanted palpebral fissure 90% Abnormality of the palate 50% Aplasia/Hypoplasia of the eyebrow 50% Blepharophimosis 50% Epicanthus 50% Long face 50% Microcornea 50% Microdontia 50% Muscle weakness 50% Myopia 50% Narrow face 50% Nystagmus 50% Preauricular skin tag 50% Short philtrum 50% Strabismus 50% Telecanthus 50% Thin vermilion border 50% Wide mouth 50% C...	0.0
  Is protein C deficiency inherited ?	The heart has an internal electrical system that controls the rhythm of the heartbeat. Problems can cause abnormal heart rhythms, called arrhythmias. There are many types of arrhythmia. During an arrhythmia, the heart can beat too fast, too slow, or it can stop beating. Sudden cardiac arrest (SCA) occurs when the heart develops an arrhythmia that causes it to stop beating. This is different than a heart attack, where the heart usually continues to beat but blood flow to the heart is blocked. There are many possible causes of SCA. They include coronary heart disease, physical stress, and some inherited disorders. Sometimes there is no known cause for the SCA. Without medical attention, the person will die within a few minutes. People are less likely to die if they have early defibrillation. Defibrillation sends an electric shock to restore the heart rhythm to normal. You should give cardiopulmonary resuscitation (CPR) to a person having SCA until defibrillation can be done. If...	0.0

• Loss: CosineSimilarityLoss with these parameters:
  json

  1{ 2 "loss_fct": "torch.nn.modules.loss.MSELoss" 3}

Training Hyperparameters

Non-Default Hyperparameters

• per_device_train_batch_size: 32
• per_device_eval_batch_size: 32
• num_train_epochs: 1
• multi_dataset_batch_sampler: round_robin

All Hyperparameters

Framework Versions

• Python: 3.13.1
• Sentence Transformers: 4.1.0
• Transformers: 4.52.4
• PyTorch: 2.6.0+cpu
• Accelerate: 1.7.0
• Datasets: 3.6.0
• Tokenizers: 0.21.1

Citation

BibTeX

Sentence Transformers