StrictSentenceTransformer based on intfloat/e5-base-v2

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: intfloat/e5-base-v2
• Maximum Sequence Length: 512 tokens
• Output Dimensionality: 768 dimensions
• Similarity Function: Cosine Similarity
• Training Dataset:
  • bge-multilingual-gemma2-data

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

StrictSentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False, 'architecture': 'BertModel'})
  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
)

Usage

Direct Usage (Sentence Transformers)

Evaluation

Metrics

My Information Retrieval

• Datasets: train_subset and dev_subset
• Evaluated with training.train_utils.my_sentence_transformers.MyInformationRetrievalEvaluator.MyInformationRetrievalEvaluator

Training Details

Training Dataset

bge-multilingual-gemma2-data

• Dataset: bge-multilingual-gemma2-data at ef165e1
• Size: 1,534,495 training samples
• Columns: anchor, positive, and negative
• Approximate statistics based on the first 1000 samples:

  	anchor	positive	negative
  type	string	string	string
  details	min: 6 tokens mean: 10.85 tokens max: 36 tokens	min: 21 tokens mean: 85.96 tokens max: 206 tokens	min: 21 tokens mean: 86.98 tokens max: 237 tokens

• Samples:

  anchor	positive	negative
  query: lee price wrestler	passage: - April 15, 2017. Lee Price Star Wrestler. Lee Price, the blonde 1990’s female wrestling Icon was fun to watch and seemed to be even more enjoyable to be around. As we all know, people who take life too seriously are no fun to be around especially if they are family or friends.	passage: - JACKSONVILLE, Fla. – William Donovan Lee, 42, was found guilty as charged Thursday afternoon of two counts of Attempted Murder in the First Degree, one count of Shooting or Throwing Deadly Missiles, and one count of Tampering with….
  query: what type of soil are crops grown	passage: Types of Soils Soil types according to depth are as follows: 1) Shallow Soil - Soil depth less than 22.5cm. Only shallow rooted crops are grown in such soil, e.g. Paddy, Nagli. 2) Medium deep soil - Soil depth is 22.5 to 45cm. Crops with medium deep roots are grown in this type of soil e.g. Sugar cane, Banana, Gram. 3) Deep soil - Soil depth is more than 45cm. Crops with long and deep roots are grown in this type a soil e.g.	passage: - Cover crops usually are grown to prevent soil loss from wind and water erosion. Use fast-growing cover crops, such as winter wheat or annual rye, on fall-spaded gardens. A second, and probably more important reason home gardeners should use cover crops is to improve soil structure and increase organic matter.
  query: how long does lisinopril stay in your body	passage: How long does it take for lisonopril to get out of your body after stopping dose? Responses (1) The plasma half-life of lisinopril is approximately 12 hours. This means that in the average person, lisinopril should disappear from the body within 3-4 days. However, since some of the effects of the drug last longer than that, the effects of this drug can last up to 1-2 weeks after stopping the drug. Take care.	passage: Top 30 Doctor insights on: How Long Does Lisinopril Stay In Your System Not sure if: your symptoms are side effects of your new medication. It usually takes no more than 1 or 2 days for any drug to clear from your body, but it is a gradual process. Other potential problematic scenariors: Drug metabolites can hang around for longer, tissue drug levels can sometimes take longer than blood levels, any damage that it might have caused can take longer to heal. Consult your doctor. ...Read more.

• Loss: training.train_utils.my_sentence_transformers.MyCachedMultipleNegativesRankingLoss.MyCachedMultipleNegativesRankingLoss with these parameters:
  json

  1{ 2 "scale": 100.0, 3 "similarity_fct": "cos_sim", 4 "mini_batch_size": 96, 5 "gather_across_devices": false 6}

Evaluation Dataset

bge-multilingual-gemma2-data

• Dataset: bge-multilingual-gemma2-data at ef165e1
• Size: 7,712 evaluation samples
• Columns: anchor, positive, and negative
• Approximate statistics based on the first 1000 samples:

  	anchor	positive	negative
  type	string	string	string
  details	min: 6 tokens mean: 10.99 tokens max: 32 tokens	min: 25 tokens mean: 87.85 tokens max: 235 tokens	min: 22 tokens mean: 87.77 tokens max: 205 tokens

• Samples:

  anchor	positive	negative
  query: what is dornase alfa meaning	passage: - Dornase alfa is a biosynthetic form of human DNase I. The enzyme is involved in endonucleolytic cleavage of extracellular DNA to 5´-phosphodinucleotide and 5´-phosphooligonucleotide end products.It has no effect on intracellular DNA.tudies in rats indicate that, following aerosol administration, the disappearance half-life of dornase alfa from the lungs is 11 hours. In humans, sputum DNase levels declined below half of those detected immediately post-administration within 2 hours but effects on sputum rheology persisted beyond 12 hours.	passage: âDead on arrivalâ DOA or dead on arrival traditionally is the official terminology used by the trauma center where a victim is received. Trauma centers (emergency rooms) are where the official pronouncement (declaration) of death is made by the attending physician, and it is pronounced at the time the victim arrives at the facility.
  query: what is a domain name?	passage: Domain name A domain name is an identification string that defines a realm of administrative autonomy, authority or control within the Internet. Domain names are formed by the rules and procedures of the Domain Name System (DNS). Any name registered in the DNS is a domain name.Domain names can also be thought of as a location where certain information or activities can be found. Domain names are used in various networking contexts and application-specific naming and addressing purposes. fictitious domain name is a domain name used in a work of fiction or popular culture to refer to a domain that does not actually exist, often with invalid or unofficial top-level domains such as .web , a usage exactly analogous to the dummy 555 telephone number prefix used in film and other media.	passage: - The Internet Domain Name System (DNS) is the Internet’s hierarchical address. system that helps users find targeted webpages. The DNS functions like a telephone. directory for the Internet; a domain name is the user -friendly form of a webpage’s. “phone number,” which is called the Internet Protocol (IP) address.
  query: harmful effects of inflammation	passage: Doctor speaks on health effects of chronic inflammation Doctor speaks on health effects of chronic inflammation. If your body is in a chronic state of inflammation, it can have serious effects on your cellular health, and has been linked to degenerative diseases including cancer, heart disease, diabetes, Alzheimer's and many others.	passage: 10 Top Foods That Prevent Inflammation in Your Body And if you want to get or remain healthy, you definitely want to reduce the damaging effects of it! Inflammation has a positive and negative affect in your body. Inflammation has a positive side because it helps your body respond to stress. But chronic low-grade inflammation is thought to be one of the leading causes of disease, premature aging and illness. When you get a cold, your body responds with inflammation in the form of a fever that helps you heal.

• Loss: training.train_utils.my_sentence_transformers.MyCachedMultipleNegativesRankingLoss.MyCachedMultipleNegativesRankingLoss with these parameters:
  json

  1{ 2 "scale": 100.0, 3 "similarity_fct": "cos_sim", 4 "mini_batch_size": 96, 5 "gather_across_devices": false 6}

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: steps
• per_device_train_batch_size: 256
• learning_rate: 2e-05
• weight_decay: 0.01
• num_train_epochs: 1
• warmup_ratio: 0.1
• bf16: True
• dataloader_num_workers: 15
• load_best_model_at_end: True
• gradient_checkpointing: True
• eval_on_start: True

All Hyperparameters

Training Logs

Framework Versions

• Python: 3.10.18
• Sentence Transformers: 5.1.0
• Transformers: 4.57.1
• PyTorch: 2.9.1+cu128
• Accelerate: 1.10.1
• Datasets: 4.0.0
• Tokenizers: 0.22.0

Citation

BibTeX

Sentence Transformers

MyCachedMultipleNegativesRankingLoss