SentenceTransformer

Model Details

Model Description

• Model Type: Sentence Transformer

• Maximum Sequence Length: 1024 tokens
• Output Dimensionality: 384 dimensions
• Similarity Function: Cosine Similarity
• Training Dataset:
  • parquet

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 1024, 'do_lower_case': False}) with Transformer model: BertModel 
  (1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
)

Usage

Direct Usage (Sentence Transformers)

Training Details

Training Dataset

parquet

• Dataset: parquet
• Size: 33,870,508 training samples
• Columns: anchor and positive
• Approximate statistics based on the first 1000 samples:

  	anchor	positive
  type	string	string
  details	min: 5 tokens mean: 36.24 tokens max: 106 tokens	min: 30 tokens mean: 328.76 tokens max: 1024 tokens

• Samples:

  anchor	positive
  How TO OBTAIN THE BRAIN OF THE CAT.	How to obtain the Brain of the Cat, (Wilder).-Correction: Page 158, second column, line 7, "grains," should be "grams;" page 159, near middle of 2nd column, "successily," should be "successively;" page 161, the number of Flower's paper is 3.
  ADDRESS OF COL. GARRICK MALLERY, U. S. ARMY.	It may be conceded that after man had all his present faculties, he did not choose between the adoption of voice and gesture, and never with those faculties, was in a state where the one was used, to the absolute exclusion of the other. The epoch, however, to which our speculations relate is that in which he had not reached the present symmetric development of his intellect and of his bodily organs, and the inquiry is: Which mode of communication was earliest adopted to his single wants and informed intelligence? With the voice he could imitate distinictively but few sounds of nature, while with gesture he could exhibit actions, motions, positions, forms, dimensions, directions and distances, with their derivations and analogues. It would seem from this unequal division of capacity that oral speech remained rudimentary long after gesture had become an efficient mode of communication. With due allowance for all purely imitative sounds, and for the spontaneous action of vocal organs unde...
  DOLBEAR ON THE NATURE AND CONSTITUTION OF MATTER.	Mr. Dopp desires to make the following correction in his paper in the last issue: "In my article on page 200 of "Science", the expression and should have been and being the velocity of light.

• Loss: MultipleNegativesRankingLoss with these parameters:
  json

  1{ 2 "scale": 20.0, 3 "similarity_fct": "cos_sim" 4}

Evaluation Dataset

parquet

• Dataset: parquet
• Size: 33,870,508 evaluation samples
• Columns: anchor and positive
• Approximate statistics based on the first 1000 samples:

  	anchor	positive
  type	string	string
  details	min: 6 tokens mean: 24.64 tokens max: 64 tokens	min: 9 tokens mean: 281.83 tokens max: 894 tokens

• Samples:

  anchor	positive
  Noticing education campaigns or public health messages about vaping among youth in the United States, Canada and England from 2018 to 2022.	Public health campaigns have the potential to correct vaping misperceptions. However, campaigns highlighting vaping harms to youth may increase misperceptions that vaping is equally/more harmful than smoking. Vaping campaigns have been implemented in the United States and Canada since 2018 and in England since 2017 but with differing focus: youth vaping prevention. Over half of youth reported noticing vaping campaigns, and noticing increased from August 2018 to February 2020. Consistent with implementation of youth vaping prevention campaigns in the United States and Canada, most youth reported noticing vaping campaigns/messages, and most were perceived to negatively portray vaping.
  Comprehensive performance evaluation of six bioaerosol samplers based on an aerosol wind tunnel.	Choosing a suitable bioaerosol sampler for atmospheric microbial monitoring has been a challenge to researchers interested in environmental microbiology, especially during a pandemic. However, a comprehensive and integrated evaluation method to fully assess bioaerosol sampler performance is still lacking. Herein, we constructed a customized wind tunnel operated at 2-20 km/h wind speed to systematically and efficiently evaluate the performance of six frequently used samplers, where various aerosols, including Arizona test dust, bacterial spores, gram-positive and gram-negative bacteria, phages, and viruses, were generated. After 10 or 60 min of sampling, the physical and biological sampling efficiency and short or long-term sampling capabilities were determined by performing aerodynamic particle size analysis, live microbial culturing, and a qPCR assay. The results showed that AGI-30 and BioSampler impingers have good physical and biological sampling efficiencies for short-term sampling...
  The occurrence, sources, and health risks of substituted polycyclic aromatic hydrocarbons (SPAHs) cannot be ignored.	Similar to parent polycyclic aromatic hydrocarbons (PPAHs), substituted PAHs (SPAHs) are prevalent in the environment and harmful to humans. However, they have not received much attention. This study investigated the occurrence, distribution, and sources of 10 PPAHs and 15 SPAHs in soil, water, and indoor and outdoor PM2.5 and dust in high-exposure areas (EAH) near industrial parks and low-exposure areas (EAL) far from industrial parks. PAH pollution in all media was more severe in the EAH than in the EAL. All SPAHs were detected in this study, with alkylated and oxygenated PAHs being predominant. Additionally, 3-OH-BaP and 1-OH-Pyr were detected in all dust samples in this study, and 6-N-Chr, a compound with carcinogenicity 10 times higher than that of BaP, was detected at high levels in all tap water samples. According to the indoor-outdoor ratio, PAHs in indoor PM2.5 in the EAH mainly originated from indoor pollution sources; however, those in the EAL were simultaneously affected by...

• Loss: MultipleNegativesRankingLoss with these parameters:
  json

  1{ 2 "scale": 20.0, 3 "similarity_fct": "cos_sim" 4}

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: steps
• per_device_train_batch_size: 128
• learning_rate: 2e-05
• num_train_epochs: 2
• max_steps: 502764
• log_level: info
• fp16: True
• dataloader_num_workers: 16
• load_best_model_at_end: True
• resume_from_checkpoint: True

All Hyperparameters

Training Logs

Framework Versions

• Python: 3.11.11
• Sentence Transformers: 3.4.1
• Transformers: 4.48.2
• PyTorch: 2.6.0+cu124
• Accelerate: 1.3.0
• Datasets: 3.2.0
• Tokenizers: 0.21.0

Citation

BibTeX

Sentence Transformers

MultipleNegativesRankingLoss