SentenceTransformer based on sentence-transformers/all-MiniLM-L6-v2

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: sentence-transformers/all-MiniLM-L6-v2
• Maximum Sequence Length: 512 tokens
• Output Dimensionality: 384 dimensions
• Similarity Function: Cosine Similarity

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False, 'architecture': 'BertModel'})
  (1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
)

Usage

Direct Usage (Sentence Transformers)

Training Details

Training Dataset

Unnamed Dataset

• Size: 420,570 training samples
• Columns: sentence_0, sentence_1, and sentence_2
• Approximate statistics based on the first 1000 samples:

  	sentence_0	sentence_1	sentence_2
  type	string	string	string
  details	min: 7 tokens mean: 164.03 tokens max: 512 tokens	min: 6 tokens mean: 197.0 tokens max: 512 tokens	min: 6 tokens mean: 178.02 tokens max: 512 tokens

• Samples:

  sentence_0	sentence_1	sentence_2
  Why have some analysts suggested that the outcome of Najib Razak's corruption trial could have significant implications for Malaysia's political landscape and the future of its democracy?	Mengapa sesetengah penganalisis mencadangkan bahawa keputusan perbicaraan rasuah Najib Razak boleh memberi implikasi yang besar kepada landskap politik Malaysia dan masa depan demokrasinya?	A warming climate can significantly affect the emergence times of certain insect species, as many insects are ectothermic and rely on external environmental conditions to regulate their body temperature. This means that their development, reproduction, and behavior are closely linked to temperature and other climatic factors. As global temperatures rise, these changes can lead to shifts in the timing of insect emergence, which can have cascading effects on ecosystem interactions and services.[object Object][object Object]1. Phenological shifts: Warmer temperatures can lead to earlier emergence of insects, a phenomenon known as phenological shifts. This can result in a mismatch between the timing of insect emergence and the availability of their food resources, such as plants or other prey species. This mismatch can negatively impact the survival and reproduction of insects, as well as the species that depend on them for food.[object Object][object Object]2. Altered species interactions: Shifts in insect emergence times can also affect speci...
  Corruption can have a significant impact on economic development and social inequality in Malaysia.[object Object][object Object]Economic Development:[object Object]Corruption can hinder economic development by discouraging investment, distorting markets, and undermining the rule of law. When businesses and individuals perceive a high level of corruption in a country, they may be less likely to invest or start businesses there, as they see it as a risky and unpredictable environment. This can limit the creation of jobs and the growth of industries, ultimately hindering economic development.[object Object][object Object]Corruption can also distort markets by giving certain individuals or companies an unfair advantage. For example, if a company is able to secure a government contract through bribery or cronyism, it can stifle competition and lead to lower quality goods and services at higher prices. This can discourage innovation and entrepreneurship, further hindering economic development.[object Object][object Object]Social Inequality:[object Object]Corruption can also contribute to social inequ...	Rasuah boleh memberi kesan yang ketara kepada pembangunan ekonomi dan ketidaksamaan sosial di Malaysia.[object Object][object Object]Pembangunan Ekonomi:[object Object]Rasuah boleh menghalang pembangunan ekonomi dengan menggalakkan pelaburan, memutarbelitkan pasaran, dan menjejaskan kedaulatan undang-undang. Apabila perniagaan dan individu melihat tahap rasuah yang tinggi di sesebuah negara, mereka mungkin kurang berkemungkinan untuk melabur atau memulakan perniagaan di sana, kerana mereka melihatnya sebagai persekitaran yang berisiko dan tidak dapat diramalkan. Ini boleh mengehadkan penciptaan pekerjaan dan pertumbuhan industri, akhirnya menghalang pembangunan ekonomi.[object Object][object Object]Rasuah juga boleh memutarbelitkan pasaran dengan memberikan individu atau syarikat tertentu kelebihan yang tidak adil. Sebagai contoh, jika syarikat mampu mendapatkan kontrak kerajaan melalui rasuah atau kronisme, ia boleh menyekat persaingan dan membawa kepada barangan dan perkhidmatan berkualiti rendah pada harga yang lebih tinggi. Ini boleh menghalang inova...	"What are the specific mechanisms through which immunoglobulins act to neutralize antigens and prevent infections?"
  He, who is also Minister of Public Health, Housing and Local Government Councils, said there were 302,243 Sarawakians at risk or recipients who should be more than 60 years old and had the second dose of COVID-19 on April	Iya ti mega Menteri Pengerai Mensia Mayuh, Pengawa Berumah enggau Kaunsil Kandang Menua madahka, bisi 302,243 rayat Sarawak ti bisi risiko tauka penerima ke patut beumur lebih 60 taun merima tuchuk kedua dos penyungkak kedua COVID-19 berengkah kena 12 April tu tadi.	What are the basic skills required to be a good programmer?

• Loss: TripletLoss with these parameters:
  json

  1{ 2 "distance_metric": "TripletDistanceMetric.EUCLIDEAN", 3 "triplet_margin": 5 4}

Training Hyperparameters

Non-Default Hyperparameters

• per_device_train_batch_size: 32
• per_device_eval_batch_size: 32
• num_train_epochs: 4
• fp16: True
• multi_dataset_batch_sampler: round_robin

All Hyperparameters

Training Logs

Framework Versions

• Python: 3.12.12
• Sentence Transformers: 5.1.2
• Transformers: 4.57.1
• PyTorch: 2.9.0+cu126
• Accelerate: 1.11.0
• Datasets: 4.0.0
• Tokenizers: 0.22.1

Citation

BibTeX

Sentence Transformers

TripletLoss