SentenceTransformer based on intfloat/e5-small-v2

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: intfloat/e5-small-v2
• Maximum Sequence Length: 512 tokens
• Output Dimensionality: 384 dimensions
• Similarity Function: Cosine Similarity
• Supported Modality: Text

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'transformer_task': 'feature-extraction', 'modality_config': {'text': {'method': 'forward', 'method_output_name': 'last_hidden_state'}}, 'module_output_name': 'token_embeddings', 'architecture': 'BertModel'})
  (1): Pooling({'embedding_dimension': 384, 'pooling_mode': 'mean', 'include_prompt': True})
  (2): Normalize({})
)

Usage

Direct Usage (Sentence Transformers)

Evaluation

Metrics

Information Retrieval

• Dataset: medichat-golden-eval
• Evaluated with InformationRetrievalEvaluator with these parameters:
  json

  1{ 2 "query_prompt": "query: ", 3 "corpus_prompt": "passage: " 4}

Training Details

Training Dataset

Unnamed Dataset

• Size: 1,709 training samples
• Columns: anchor, positive, and negative
• Approximate statistics based on the first 100 samples:

  	anchor	positive	negative
  type	string	string	string
  modality	text	text	text
  details	min: 8 tokens mean: 24.89 tokens max: 58 tokens	min: 93 tokens mean: 258.62 tokens max: 512 tokens	min: 69 tokens mean: 286.18 tokens max: 512 tokens

• Samples:

  anchor	positive	negative
  query: Madam, patient get chest pain with nausea and black stool. Pulse na 45. How I take am?	passage: I. Chest pain with any of the Pulse < 50/min Or > 100/min Severe condition REFER immediately to the following: BP > 180/110mmHg appropriate health facility. Nausea Difficult breathing Vomiting Pain radiates to neck, arm, shoulder and back II. Chest pain BP <90/60mmHg Temperature Severe condition 1. IV Normal saline 500ml, stop if 37.2°C breathing becomes worse 2. IV/IM Ceftriaxone 1g stat If no improvement, REFER appro- priately.. III. Chest pain becomes Severe pain Severe condition REFER immediately to the appro- worse on lying down or deep priate health facility. breathing IV. Severe chest pain and In pains Severe condition Low- Osmolarity ORS or known sickle cell disease IV Normal Saline 500ml 6hourly REFER if no improvement appro- priately. V. Central chest pain, radiates Central chest pain Severe condition (suspect REFER immediately to the to the neck, jaw and arm that angina) appropriate health facility. is : recurrent attack (joint pain) resulting from physical activity...	passage: 1.How long have you had this complaint? Is this the first time? 1. General appearance: Ill-looking 2.Have you had a good appetite? Any nausea or vomiting? 2. Temperature, pulse respiration, blood pressure: check and 3.Have you been urinating more frequently at night? Any pain on record micturition? 3. Face: Puffy 4.Any bleeding from nose? 4. Eyes:pallor jaundice * Vomiting or coughing blood? 5. Chest: crepitation, wheezes, decreased breath sounds * Blood in the urine or stool? Black stool? 6. Heart: rate, rhythm, 5.Any cough? Or breathlessness at night? 7. Abdomen: large tender liver, enlarged spleen 6.Do you sleep with extra pillow? 8. Limbs: a) legs 7.Have you ever been treated for jaundice? i) for oedema ii) does swelling pit on pressure (if not pitting, think of ele- phantiasis) b) hands for oedema 10. Urine: check for protein and sugar FINDING ON HISTORY FINDINGS ON CLINICAL ACTION EXAMINATION JUDGEMENT I. Swollen legs with large Swollen legs Severe condition REFER immedi...
  query: What is the correct Ribavir dose for a child weighing 3kg	passage: Hepatitis: Diffuse inflammation of the liver that can be caused by infective agents, drugs, alcohol, autoimmune and toxins. Clinical Features: Acute hepatitis (lasting for less than 6 months): Mild-to-moderate jaundice, Vague right upper quadrant discomfort, Fever, Hepatomegaly. Chronic hepatitis (lasting more than 6 months): General malaise/Fatigue, Re-occurence of jaundice. Complications: Liver failure, Bleeding tendencies, Cirrhosis/Liver cancer. Investigations: Liver Function Tests, Serologic markers of Hepatitis A, B, C, D and E, Viral load, Abdominal ultrasonography, Prothrombin time, HIV Screening. Treatment Goals: Provide supportive measures, Prevent progression to chronic phase. Non-drug Treatment: High carbohydrate and Normal protein diet, Discontinuation of hepatotoxic medication, Bed rest. Drug Treatment: Chronic Hepatitis B — Treatment is required in patients with viral load exceeding 2000 IU/ml for HBeAg negative or 20000 IU/ml for HBeAg positive status. Pegylate...	passage: Medicine doses in children are generally based on body weight in kilograms or age ranges: first one month (neonate), up to 1 year (infant), 1-5 years, and 6-12 years. Unless age is specified, the term child includes persons aged 12 years and below. Doses are calculated based on body weight or body surface area in square metres. Body Surface Area estimates are more accurate for calculation of paediatric doses as many physiological phenomena correlate better to BSA. For most medicines the adult maximum dose should not be exceeded. For example if the dose is stated as 4 mg/kg with max 180 mg, a child weighing 10 kg should receive 40 mg but a child weighing 50 kg should receive 180 mg not 200 mg. Young children may require higher doses per kilogram than adults because of their higher metabolic rate. Calculation by body weight in an overweight child may result in much higher doses than necessary so doses should be calculated based on ideal body weight in relation to height and age....
  query: Aunty, girl dey bleed plenty during period with clots and she pale. Which care I go give for clinic?	passage: I. Abdominal pain with men- Lower abdominal tenderness, Moderate condition 1.Reassure the client/patient struation; Foul smelling High temperature Suspect infection 2. Counsel on personal hygiene discharge per vagina; Fever (use of sanitary pad) 3. Capsule Amoxicillin 250mg 8hourly for 5 days 4. Conduct RDT, if positive, treat for uncomplicated malaria 5. Review in 5 days, if no improvement REFER immediately to the appropriate health facility II. Heavy menstrual flow with May be pale Moderate condition 1.Reassure the client/patient clots, prolonged menstruation Blood clots per vagina Abnormal menstrual flow 2. Tablet Paracetamol 500mg 8hourly for 3 days III. Lower abdominal pain Lower abdominal Mild condition 1.Tablet Paracetamol 500 mg associated with menstruation tenderness, no fever, Suspect dysmenorrhea 8hourly for 3days No foul smelling Reassure and counsel discharge IV. Mucus or blood per vagina Normal mucus, no Mild condition 1. Counsel and reassure patient. smell Norma...	passage: 1.Have you used any contraceptive method before? General appearance: anxious thin, obese, ill, 2.What method were you using? Which Clinic did you attend? Skin: scars (signs of domestic violence) Why do you want to attend this particular clinic? Weight: weigh and record 3.Who referred you to this Clinic? Blood pressure: measure and record 4.How many children have you had? How many are alive? How Hair: hair loss especially in temporal region many dead? When did you have your last baby? Did you have a Face: swelling normal vaginal delivery or were you assisted (caesarean section, Eyes: pallor or jaundice forceps delivery or vacuum extraction). Neck: goitre, lymph nodes 5.Are you breastfeeding? Chest: shape, respiratory difficulty or rapid creps or wheeze 6.Are you menstruating now? When did you start? If not, when Heart: rate, rhythm, murmur was the last menstrual period? Breast: lump, dimpling of the skin, abnormal appearance of the 7.Do you normally have; nipples, retraction of...

• Loss: MultipleNegativesRankingLoss with these parameters:
  json

  1{ 2 "scale": 20.0, 3 "similarity_fct": "cos_sim", 4 "gather_across_devices": false, 5 "directions": [ 6 "query_to_doc" 7 ], 8 "partition_mode": "joint", 9 "hardness_mode": null, 10 "hardness_strength": 0.0 11}

Training Hyperparameters

Non-Default Hyperparameters

• per_device_train_batch_size: 32
• gradient_accumulation_steps: 2
• learning_rate: 2e-05
• num_train_epochs: 20
• warmup_steps: 0.1
• fp16: True
• load_best_model_at_end: True
• gradient_checkpointing: True
• batch_sampler: no_duplicates

All Hyperparameters

Training Logs

• The bold row denotes the saved checkpoint.

Training Time

• Training: 29.2 minutes

Framework Versions

• Python: 3.12.13
• Sentence Transformers: 5.6.0
• Transformers: 5.0.0
• PyTorch: 2.10.0+cu128
• Accelerate: 1.14.0
• Datasets: 5.0.0
• Tokenizers: 0.22.2

Citation

BibTeX

Sentence Transformers

MultipleNegativesRankingLoss