SentenceTransformer based on sucharush/e5_stem_finetuned

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: sucharush/e5_stem_finetuned
• Maximum Sequence Length: 512 tokens
• Output Dimensionality: 768 dimensions
• Similarity Function: Cosine Similarity

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

Training Details

Training Dataset

Unnamed Dataset

• Size: 153,400 training samples
• Columns: sentence_0, sentence_1, and label
• Approximate statistics based on the first 1000 samples:

  	sentence_0	sentence_1	label
  type	string	string	int
  details	min: 17 tokens mean: 206.37 tokens max: 512 tokens	min: 17 tokens mean: 206.37 tokens max: 512 tokens	1: 100.00%

• Samples:

  sentence_0	sentence_1	label
  Question: where did the term dark ages come from, Answer: Dark Ages (historiography) The term employs traditional light-versus-darkness imagery to contrast the era's "darkness" with earlier and later periods of "light".[3] The concept of a "Dark Age" originated in the 1330s with the Italian scholar Petrarch, who regarded the post-Roman centuries as "dark" compared to the light of classical antiquity.[3][4] The phrase "Dark Age" itself derives from the Latin saeculum obscurum, originally applied by Caesar Baronius in 1602 to a tumultuous period in the 10th and 11th centuries.[5] The concept thus came to characterize the entire Middle Ages as a time of intellectual darkness between the fall of Rome and the Renaissance; this became especially popular during the 18th-century Age of Enlightenment.[3]	Question: where did the term dark ages come from, Answer: Dark Ages (historiography) The term employs traditional light-versus-darkness imagery to contrast the era's "darkness" with earlier and later periods of "light".[3] The concept of a "Dark Age" originated in the 1330s with the Italian scholar Petrarch, who regarded the post-Roman centuries as "dark" compared to the light of classical antiquity.[3][4] The phrase "Dark Age" itself derives from the Latin saeculum obscurum, originally applied by Caesar Baronius in 1602 to a tumultuous period in the 10th and 11th centuries.[5] The concept thus came to characterize the entire Middle Ages as a time of intellectual darkness between the fall of Rome and the Renaissance; this became especially popular during the 18th-century Age of Enlightenment.[3]	1
  Question: when do they put up tree in rockefeller center, Answer: Rockefeller Center Christmas Tree The tree, usually a Norway spruce 69 to 100 feet (21 to 30 m) tall, has been a national tradition each year since 1933.[3] The 2017 Christmas Tree Lighting took place on November 29, 2017; the tree remains on display until January 7, 2018.	Question: when do they put up tree in rockefeller center, Answer: Rockefeller Center Christmas Tree The tree, usually a Norway spruce 69 to 100 feet (21 to 30 m) tall, has been a national tradition each year since 1933.[3] The 2017 Christmas Tree Lighting took place on November 29, 2017; the tree remains on display until January 7, 2018.	1
  Question: what are the lights on the curling stone, Answer: Curling A handle is attached by a bolt running vertically through a hole in the centre of the stone. The handle allows the stone to be gripped and rotated upon release; on properly prepared ice the rotation will bend (curl) the path of the stone in the direction in which the front edge of the stone is turning, especially as the stone slows. Handles are coloured to identify each team, two popular colours in major tournaments being red and yellow. In competition, an electronic handle known as the eye on the hog may be fitted to detect hog line violations. This electronically detects whether the thrower's hand is in contact with the handle as it passes the hog line and indicates a violation by lights at the base of the handle. The eye on the hog eliminates human error and the need for hog line officials. It is mandatory in high-level national and international competition, but its cost, around US$650 each, currently puts it beyon...	Question: what are the lights on the curling stone, Answer: Curling A handle is attached by a bolt running vertically through a hole in the centre of the stone. The handle allows the stone to be gripped and rotated upon release; on properly prepared ice the rotation will bend (curl) the path of the stone in the direction in which the front edge of the stone is turning, especially as the stone slows. Handles are coloured to identify each team, two popular colours in major tournaments being red and yellow. In competition, an electronic handle known as the eye on the hog may be fitted to detect hog line violations. This electronically detects whether the thrower's hand is in contact with the handle as it passes the hog line and indicates a violation by lights at the base of the handle. The eye on the hog eliminates human error and the need for hog line officials. It is mandatory in high-level national and international competition, but its cost, around US$650 each, currently puts it beyon...	1

• Loss: ContrastiveTensionLoss

Training Hyperparameters

Non-Default Hyperparameters

• per_device_train_batch_size: 20
• per_device_eval_batch_size: 20
• num_train_epochs: 1
• multi_dataset_batch_sampler: round_robin

All Hyperparameters

Training Logs

Framework Versions

• Python: 3.12.8
• Sentence Transformers: 3.4.1
• Transformers: 4.52.4
• PyTorch: 2.6.0+cu126
• Accelerate: 1.3.0
• Datasets: 3.2.0
• Tokenizers: 0.21.0

Citation

BibTeX

Sentence Transformers

ContrastiveTensionLoss