SentenceTransformer based on sentence-transformers/all-MiniLM-L6-v2

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: sentence-transformers/all-MiniLM-L6-v2
• Maximum Sequence Length: 256 tokens
• Output Dimensionality: 384 dimensions
• Similarity Function: Cosine Similarity

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 256, 'do_lower_case': False}) with Transformer model: BertModel 
  (1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

Training Details

Training Dataset

Unnamed Dataset

• Size: 277,218 training samples
• Columns: sentence_0 and sentence_1
• Approximate statistics based on the first 1000 samples:

  	sentence_0	sentence_1
  type	string	string
  details	min: 8 tokens mean: 154.02 tokens max: 256 tokens	min: 3 tokens mean: 65.77 tokens max: 256 tokens

• Samples:

  sentence_0	sentence_1
  [PC BROWSER] [LATE 2000] Old flash, creepy, mystery, puzzle game[object Object][object Object]I can hardly remember it but I think it had something to do with a point and click sort of puzzle where you would visit different planets. One planet had an old man sleeping, his nose/mouth was making bubbles and you could pop them. [object Object][object Object]You sort of interacted with the world until you figured something out in the correct order. It was possibly in black and white? [object Object][object Object]It had a creepy, weird sort of art style maybe.	[PC] [Unknown] Game about a child on the moon[object Object][object Object]Hello, I was recently thinking back to some of my years in primary school and remembered small bits and pieces of one of the few games we were allowed to play back then; Something about a character (probably a child) in an astronaut costume on the moon (I think we were accompanied by a dog too), I don't know what exactly this kind of game is called but it was set up terraria, where the world is almost 2D in appearance. The character models were 3D, but you could only see the side views (I believe anyways, I also remember getting stuck playing this game really easily so maybe I just never got to a point where you could see the rest of the model) [object Object]I remember having played this around 2016-2017 (I'd be 8 or 9) because my school only let people use the allocated computers when they reach the grade I was in at that time, but I suspect the game is older than that. Seeing as that was 7-8 years ago (wow), I don't remember very much about it, but ...
  [PC][early 2000s] Kid’s game with pirate mice[object Object][object Object]Platform: PC[object Object][object Object]Estimated year of release: I believe I played in early to mid 2000s[object Object][object Object]Genre: Children’s Learning Game[object Object][object Object]Graphics/art style: cartoonish [object Object][object Object]Notable characters: from what I remember — villainous pirate mice, hero mice, one was a bigger, goofy mouse (I think he was a pirate) [object Object][object Object]Notable gameplay mechanics: I think the goal was to thwart the pirate mice from stealing/hoarding cheese[object Object][object Object]Other details: I remember a pretty fleshed out storyline; good voice acting; a mouse on the hero side with blonde hair I think. It’s also possible all the mice were pirates and that there were just good and bad mice pirates. I also think I remember a flying ship. Thanks!	[PC] [late 1990s-early 2000s] educational children's game with female mouse who sails on a ship[object Object][object Object]I'm specifically trying to find either what I think is either an opening or ending cutscene. There's a female mouse (or some other kind of rodent) on a ship at sunset, singing a song about sailing on the open sea. I think she has a male mouse companion, and possibly other animals. I believe the game is mostly math problems. Something like a Jumpstart or Reader Rabbit game, but I haven't been able to find this cutscene in any playthroughs that I've scene on Youtube.
  All I know is there was a shark scene[object Object][object Object]All I can remember about this game is that at some point you're at a movie studio type area (maybe?) and you recreate the scene in jaws where the ship sinks and you have to climb up the mast of the fishing boat. Its killing me please someone put me out of my misery.	universal studios theme park adventure for gamecube

• Loss: MultipleNegativesRankingLoss with these parameters:
  json

  1{ 2 "scale": 20.0, 3 "similarity_fct": "cos_sim" 4}

Training Hyperparameters

Non-Default Hyperparameters

• per_device_train_batch_size: 128
• per_device_eval_batch_size: 128
• multi_dataset_batch_sampler: round_robin

All Hyperparameters

Training Logs

Framework Versions

• Python: 3.11.5
• Sentence Transformers: 3.4.1
• Transformers: 4.57.6
• PyTorch: 2.5.1+cu124
• Accelerate: 1.13.0
• Datasets: 3.6.0
• Tokenizers: 0.22.2

Citation

BibTeX

Sentence Transformers

MultipleNegativesRankingLoss