all-MiniLM-L6-v33-pair_score

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: sentence-transformers/all-MiniLM-L6-v2
• Maximum Sequence Length: 256 tokens
• Output Dimensionality: 384 dimensions
• Similarity Function: Cosine Similarity
• Training Dataset:
  • pairs_with_scores_v29
• Language: en
• License: apache-2.0

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 256, 'do_lower_case': False, 'architecture': 'BertModel'})
  (1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

Training Details

Training Dataset

pairs_with_scores_v29

• Dataset: pairs_with_scores_v29 at 1df6a91
• Size: 9,464,974 training samples
• Columns: sentence1, sentence2, and score
• Approximate statistics based on the first 1000 samples:

  	sentence1	sentence2	score
  type	string	string	float
  details	min: 5 tokens mean: 7.03 tokens max: 21 tokens	min: 22 tokens mean: 116.06 tokens max: 256 tokens	min: 0.09 mean: 0.57 max: 1.0

• Samples:

  sentence1	sentence2	score
  avocado omelette roll	greek yogurt category restaurants international dairy yogurt tags cinnamon greek yogurt walnuts greek yogurt honey greek yogurt greek yogurt yogurt greek nan greek yoghurt nan yoghurt keywords greek yogurt yogurt greek nan greek yoghurt nan yoghurt description greek yogurt cinnamon walnuts honey.	0.566356
  wet brush detangler/bwr	titania hair care f/kids brush hr/1304 category beauty haircare hair brush and comb hair brush and comb tags kids hair brush girls hair brush boys hair brush unisex hair brush hair brush hair care brush titania titania hair brush keywords hair brush hair care brush titania titania hair brush attrs target group kid	0.808883
  hand cleansing gel	alin 3.5 g/pcs 20/pcs category health and nutrition dietary supplements antioxidant antioxidant tags alin keywords alin attrs units 3.5 g 20 pcs	0.234341

• Loss: CoSENTLoss with these parameters:
  json

  1{ 2 "scale": 20.0, 3 "similarity_fct": "pairwise_cos_sim" 4}

Evaluation Dataset

pairs_with_scores_v29

• Dataset: pairs_with_scores_v29 at 1df6a91
• Size: 47,563 evaluation samples
• Columns: sentence1, sentence2, and score
• Approximate statistics based on the first 1000 samples:

  	sentence1	sentence2	score
  type	string	string	float
  details	min: 5 tokens mean: 6.99 tokens max: 18 tokens	min: 22 tokens mean: 116.61 tokens max: 256 tokens	min: 0.11 mean: 0.57 max: 1.0

• Samples:

  sentence1	sentence2	score
  givenchy pour homme edt men	uncharted the lost legacy hits ps 4 category entertainment gaming video game playstation game tags gaming accessory uncharted uncharted lost legacy hits uncharted ps 4 keywords uncharted uncharted lost legacy hits uncharted ps 4 description gaming accessories.	0.244742
  lemon salt for fish and poultry	stevia green powder ground category restaurants specialty foods pantry pantry tags stevia green powder caloriefree sweetener lowcalorie sugar stevia stevia for diabetes stevia powder for beverages stevia sweetener for desserts green stevia powder ground stevia powder natural sweetener stevia powder stevia sweetener keywords green stevia powder ground stevia powder natural sweetener stevia powder stevia sweetener description enjoy the natural sweetness of stevia green powder ground a calorie-free sugar substitute. benefits 1. natural sweetener stevia green powder is a natural sugar alternative. 2. low in calories it contains virtually no calories making it suitable for calorie-conscious individuals. 3. diabetic-friendly stevia is considered safe for people with diabetes. how to use use stevia green powder to sweeten beverages desserts or any recipe that calls for sugar.	0.749969
  the ordinary body cleanser	4 my hair curly shea but.hr.cr.250 m category beauty haircare hair cream hair cream tags 4 my hair 4 my hair hair cream curly hair cream shea butter hair cream keywords 4 my hair 4 my hair hair cream curly hair cream shea butter hair cream attrs units 250 m	0.473733

• Loss: CoSENTLoss with these parameters:
  json

  1{ 2 "scale": 20.0, 3 "similarity_fct": "pairwise_cos_sim" 4}

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: steps
• per_device_train_batch_size: 128
• per_device_eval_batch_size: 128
• learning_rate: 2e-05
• num_train_epochs: 1
• warmup_ratio: 0.1
• fp16: True

All Hyperparameters

Training Logs

Framework Versions

• Python: 3.12.3
• Sentence Transformers: 5.1.0
• Transformers: 4.55.4
• PyTorch: 2.6.0+cu124
• Accelerate: 1.10.1
• Datasets: 4.0.0
• Tokenizers: 0.21.4

Citation

BibTeX

Sentence Transformers

CoSENTLoss