SentenceTransformer based on sentence-transformers/all-MiniLM-L6-v2

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: sentence-transformers/all-MiniLM-L6-v2
• Maximum Sequence Length: 256 tokens
• Output Dimensionality: 384 tokens
• Similarity Function: Cosine Similarity

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 256, 'do_lower_case': False}) with Transformer model: BertModel 
  (1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

Evaluation

Metrics

Information Retrieval

• Dataset: ir_eval
• Evaluated with InformationRetrievalEvaluator

Training Details

Training Dataset

Unnamed Dataset

• Size: 5,509 training samples
• Columns: query and document
• Approximate statistics based on the first 1000 samples:

  	query	document
  type	string	string
  details	min: 4 tokens mean: 13.07 tokens max: 44 tokens	min: 12 tokens mean: 124.26 tokens max: 256 tokens

• Samples:

  query	document
  Differnce between abilities of System apps, Apps in phone memory and Apps in the SD card	As I've played around with different ROMs and used Titanium Backup, I see that apps are categorized into system and user apps. Several ROM developers state that Titanium Backup should only be used for user apps and not for system apps, and when I proceed to uninstall system apps, TiBu warns me that the ROM may not work correctly. Other than the fact that user apps are downloadable via the Market or some other means, what are the key differences between the two? What is it about the system apps that make them more integral to the OS itself?
  Usage of Who and Whom	What's the rule for using who or whom? I was writing a LinkedIn recommendation one day, and ended up pondering for a while which of these forms to use: > … is a great developer whom I always found easy to work with. > > … is a great developer who I always found easy to work with. Both are basically correct in contemporary English, right? But is one or the other preferable, and if so, why? (In this case I went with the latter, as it seemed more common (Google) and I wanted to avoid sounding unnecessarily “archaic”, although I’m not sure whether that would have been the case. Also note that I try to write in a “friendly professional” style instead of overly formal one. :-)
  How do I override a \configure statement in html4.4t - tex4ht	Im trying to prepare html for conversion to an epub and have encountered a couple of problems that I would appreciate help with. Hope mixing a couple of related questions in a single post is OK. The easiest is the quotation environment doesnt indent both margins (and not enough on the left). Ive written a .cfg file and think I have that one solved. Heres what Im using: \Preamble{html} \begin{document} \Css { .quotation { margin-bottom:0.25em; margin-top:0.25em; margin-left:4em; margin-right:4em } } \EndPreamble The next is figures and tables. tex4ht inserts an hr tag before and after the table. This is not part of the css, its a separate tag generated by tex4ht. I havent found where one customizes this. I can delete these in emacs from the html, but that doesnt seem the right way to do this. Heres a fairly minimal example showing the rules (and the quotation indent as well). \documentclass{book} \begin{document} \chapter{Simple Example} Lorem ipsum dolor sit amet, consectetur adipiscing elit. Integer nec odio. Praesent libero. Sed cursus ante dapibus diam. Sed nisi. Nulla quis sem at nibh elementum imperdiet. Duis sagittis ipsum. Praesent mauris. Fusce nec tellus sed augue semper porta. Mauris massa. Vestibulum lacinia arcu eget nulla. \begin{quotation} Default book style icreases the left and right margins for quotations by a noticeable amount. The css generated by tex4ht only increases the left margin by one em. The attached .cfg increases this to 4 em. \end{quotation} Sed lectus. Integer euismod lacus luctus magna. Quisque cursus, metus vitae pharetra auctor, sem massa mattis sem, at interdum magna augue eget diam. Vestibulum ante ipsum primis in faucibus orci luctus et ultrices posuere cubilia Curae; Morbi lacinia molestie dui. amet mauris. \begin{table} \begin{center} \hbox{ \begin{tabular}{

• Loss: MultipleNegativesRankingLoss with these parameters:
  json

  1{ 2 "scale": 20.0, 3 "similarity_fct": "cos_sim" 4}

Training Hyperparameters

Non-Default Hyperparameters

• per_device_train_batch_size: 64
• per_device_eval_batch_size: 64
• gradient_accumulation_steps: 4
• warmup_ratio: 0.1
• batch_sampler: no_duplicates

All Hyperparameters

Training Logs

Framework Versions

• Python: 3.8.18
• Sentence Transformers: 3.2.1
• Transformers: 4.45.2
• PyTorch: 2.4.1
• Accelerate: 1.0.1
• Datasets: 3.1.0
• Tokenizers: 0.20.3

Citation

BibTeX

Sentence Transformers

MultipleNegativesRankingLoss