all-MiniLM-L6-v67-pair_score

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: KhaledReda/all-MiniLM-L6-v66-pair_score
• Maximum Sequence Length: 256 tokens
• Output Dimensionality: 384 dimensions
• Similarity Function: Cosine Similarity
• Training Dataset:
  • pairs_with_scores_v54
• Language: en
• License: apache-2.0

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 256, 'do_lower_case': False, 'architecture': 'BertModel'})
  (1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

Training Details

Training Dataset

pairs_with_scores_v54

• Dataset: pairs_with_scores_v54 at cd47d78
• Size: 12,834,902 training samples
• Columns: sentence1, sentence2, and score
• Approximate statistics based on the first 1000 samples:

  	sentence1	sentence2	score
  type	string	string	float
  details	min: 3 tokens mean: 7.46 tokens max: 23 tokens	min: 3 tokens mean: 56.15 tokens max: 234 tokens	min: 0.0 mean: 0.26 max: 1.0

• Samples:

  sentence1	sentence2	score
  nivea deep bcarbedeo ron fm 15	canon maxify gx7040 printer canon maxify gx 7040 printer maxify printer	0.0
  paris velvet the pencil	tender beef piccata white rice tender beef strips slow cooked tender beef brown sauce tender beef tender piccata white rice piccata tender beef strips slow cooked in brown sauce and served with a side of white rice.	0.0
  golden hour slipper	iris in metallic fuschia raffia metallic fuchsia slippers metallic slippers fuchsia slippers pool side slippers women slippers summer slippers iris slippers raffia slippers step out in our iris sandals. detailed design and slender sole these simple sandals pair perfectly with any outfit. it looks great from poolside to night walks. wear with cutoff jeans or a simple flowing sun dress. size fits true to size if you wear a half size take next size up. ex if you wear 38.5 order 39	1.0

• Loss: CoSENTLoss with these parameters:
  json

  1{ 2 "scale": 20.0, 3 "similarity_fct": "pairwise_cos_sim" 4}

Evaluation Dataset

pairs_with_scores_v54

• Dataset: pairs_with_scores_v54 at cd47d78
• Size: 64,497 evaluation samples
• Columns: sentence1, sentence2, and score
• Approximate statistics based on the first 1000 samples:

  	sentence1	sentence2	score
  type	string	string	float
  details	min: 4 tokens mean: 7.37 tokens max: 28 tokens	min: 4 tokens mean: 58.16 tokens max: 231 tokens	min: 0.0 mean: 0.26 max: 1.0

• Samples:

  sentence1	sentence2	score
  tunisie artemis-ivory coffee pot - rim	al alwani ajwa al madinah dates ajwa dates al alwani dates premium soft saudi dates with a fruity flavour and fine texture. dates are rich in fibre vitamins and minerals including soluble fibre potassium and iron.	0.0
  eye ring plated with	crown silver ring handcrafted ring 925 silver ring crown ring from our unique designs we created these beautiful pieces.-925 silver.	1.0
  macarona fusilli	tritace 1.25mg 14/tab 2ex.new tritace tablets	0.0

• Loss: CoSENTLoss with these parameters:
  json

  1{ 2 "scale": 20.0, 3 "similarity_fct": "pairwise_cos_sim" 4}

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: steps
• per_device_train_batch_size: 64
• per_device_eval_batch_size: 64
• learning_rate: 2e-05
• num_train_epochs: 2
• warmup_ratio: 0.1
• fp16: True

All Hyperparameters

Training Logs