SentenceTransformer based on sentence-transformers/all-MiniLM-L6-v2

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: sentence-transformers/all-MiniLM-L6-v2
• Maximum Sequence Length: 256 tokens
• Output Dimensionality: 384 dimensions
• Similarity Function: Cosine Similarity
• Supported Modality: Text

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'transformer_task': 'feature-extraction', 'modality_config': {'text': {'method': 'forward', 'method_output_name': 'last_hidden_state'}}, 'module_output_name': 'token_embeddings', 'architecture': 'BertModel'})
  (1): Pooling({'embedding_dimension': 384, 'pooling_mode': 'mean', 'include_prompt': True})
  (2): Normalize({})
)

Usage

Direct Usage (Sentence Transformers)

Training Details

Training Dataset

Unnamed Dataset

• Size: 2,082,630 training samples
• Columns: sentence_0 and sentence_1
• Approximate statistics based on the first 1000 samples:

  	sentence_0	sentence_1
  type	string	string
  details	min: 4 tokens mean: 190.49 tokens max: 256 tokens	min: 5 tokens mean: 50.76 tokens max: 256 tokens

• Samples:

  sentence_0	sentence_1
  escalating its competition with other boston - area hospital chains, for - profit company steward health care system has again lured away a major doctors group from a rival, this time grabbing a large south shore practice from partners healthcare. deep - pocketed newcomer steward said yesterday that compass medical will join its network, a move that could shake up patient and provider relationships in communities south of boston. compass medical includes 90 doctors in eight offices between braintree and taunton, and over time, doctors there probably will refer more of their thousands of patients to nearby steward - owned community hospitals for care, including quincy medical center, good samaritan medical center in brockton, and morton hospital in taunton. the change is a loss for partners, a powerful provider network that includes massachusetts general and brigham and women ’ s hospitals, which has been affiliated with compass for 16 years. steward ’ s partnership with compass comes a...	Escalating its competition with other Boston-area hospital chains, for-profit company Steward Health Care System has lured away another major doctors group from a rival, this time grabbing a large South Shore practice from Partners HealthCare. Deep-pocketed newcomer Steward said yesterday that Compass Medical will join its network - a move that could shake up patient and provider relationships in communities south of Boston.
  04 / 09 / 2015 at 07 : 55 pm edt is ( finally ) getting his own reality show – and who better to produce the docuseries than the guys behind frontman ' s move from london to los angeles, according to george, 53, announced the show by proclaiming, " if marge simpson met dolly parton and went dancing with ziggy stardust, it wouldnat come close to what youall see. " and if you had any questions as to why the former pop star has suddenly decided to try his hand at television, he ' s got the answers : " why now – why not? why me – who else? a for anyone who missed out on the ' 80s, boy george had a string of hits with his band, the culture club – including classics like " karma chameleon, " " do you really want to hurt me, " and " i ' ll tumble 4 ya. " the british singer ' s androgynous persona was considered quite shocking at the time. aboy george is a musical and cultural icon, and itas about time someone captured his story, " said gil goldschein, chairman and ceo of bmp. " we are experts...	The show will chronicle the Culture Club frontman's move from London to Los Angeles
  color in my hair because my grandson says i look younger. ’ “ some like a lot of teasing and the old - style final net hairspray. a lot of ladies feel like they are going bald, but we have all kinds of tricks up on our sleeve, like a fiber product that fills in spots. the memory issues can be a challenge ; we need to have a receptionist because often people forget their appointment or come back in after they were just here yesterday. those with alzheimer ’ s are afraid of the water, and we can ’ t lay their	You’re never too old to want to look beautiful. Ask hair salon director Bernice Cunningham at Brooksby Village in Peabody.

• Loss: MultipleNegativesRankingLoss with these parameters:
  json

  1{ 2 "scale": 20.0, 3 "similarity_fct": "cos_sim", 4 "gather_across_devices": false, 5 "directions": [ 6 "query_to_doc" 7 ], 8 "partition_mode": "joint", 9 "hardness_mode": null, 10 "hardness_strength": 0.0 11}

Training Hyperparameters

Non-Default Hyperparameters

• per_device_train_batch_size: 16
• fp16: True
• per_device_eval_batch_size: 16
• multi_dataset_batch_sampler: round_robin

All Hyperparameters

Training Logs

Training Time

• Training: 8.2 hours

Framework Versions

• Python: 3.10.12
• Sentence Transformers: 5.4.0
• Transformers: 5.5.3
• PyTorch: 2.11.0+cu128
• Accelerate: 1.13.0
• Datasets: 4.8.4
• Tokenizers: 0.22.2

Citation

BibTeX

Sentence Transformers

MultipleNegativesRankingLoss