SentenceTransformer based on BAAI/bge-base-en-v1.5

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: BAAI/bge-base-en-v1.5
• Maximum Sequence Length: 512 tokens
• Output Dimensionality: 768 dimensions
• Similarity Function: Cosine Similarity

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': True}) with Transformer model: BertModel 
  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

Evaluation

Metrics

Information Retrieval

• Evaluated with InformationRetrievalEvaluator

Training Details

Training Dataset

Unnamed Dataset

• Size: 2,355 training samples
• Columns: sentence_0, sentence_1, and sentence_2
• Approximate statistics based on the first 1000 samples:

  	sentence_0	sentence_1	sentence_2
  type	string	string	string
  details	min: 17 tokens mean: 27.87 tokens max: 59 tokens	min: 37 tokens mean: 195.56 tokens max: 512 tokens	min: 35 tokens mean: 209.44 tokens max: 512 tokens

• Samples:

  sentence_0	sentence_1	sentence_2
  Represent this sentence for searching relevant passages: What is the name of the spell that causes a person to tell the truth?	For one wild moment, Harry thought Snape was about to pull out his wand and curse him - then he saw that Snape had drawn out a small crystal bottle of a completely clear potion. Harry stared at it. "Do you know what this is, Potter?" Snape said, his eyes glittering dangerously again. "No," said Harry, with complete honesty this time. "It is Veritaserum - a Truth Potion so powerful that three drops would have you spilling your innermost secrets for this entire class to hear," said Snape viciously. "Now, the use of this potion is controlled by very strict Ministry guidelines. But unless you watch your step, you might just find that my hand slips" - he shook the crystal bottle slightly - "right over your evening pumpkin juice.	FURTHER MISTAKES AT THE MINISTRY OF MAGIC[object Object]It seems as though the Ministry of Magic's troubles are not yet at an end, writes Rita Skeeter, Special Correspondent. Recently under fire for its poor crowd control at the Quidditch World Cup, and still unable to account for the disappearance of one of its witches, the Ministry was plunged into fresh embarrassment yesterday by the antics of Arnold Weasley, of the Misuse of Muggle Artifacts Office." Malfoy looked up. "Imagine them not even getting his name right, Weasley. It's almost as though he's a complete nonentity, isn't it?" he crowed.
  Represent this sentence for searching relevant passages: In the sixth book, what does Harry see in the Pensieve about Voldemort's mother, and how does it connect to the second book?	"Voldemort's grandfather, yes," said Dumbledore. "Marvolo, his son, Morfin, and his daughter, Merope, were the last of the Gaunts, a very ancient Wizarding family noted for a vein of instability and violence that flourished through the generations due to their habit of marrying their own cousins. Lack of sense coupled with a great liking for grandeur meant that the family gold was squandered several generations before Marvolo was born. He, as you saw, was left in squalor and poverty, with a very nasty temper, a fantastic amount of arrogance and pride, and a couple of family heirlooms that he treasured just as much as his son, and rather more than his daughter." "So Merope," said Harry, leaning forward in his chair and staring at Dumbledore, "so Merope was ... Sir, does that mean she was ... Voldemort's mother?" "It does," said Dumbledore. "And it so happens that we also had a glimpse of Voldemort's father. I wonder whether you noticed?" "The Muggle Morfin attacked? The man on the horse...	Unnoticed by either, he seized the bowl that contained the pod and began to try and open it by the noisiest and most energetic means he could think of; unfortunately, he could still hear every word of their conversation. "You were going to ask me?" asked Ron, in a completely different voice. "Yes," said Hermione angrily. "But obviously if you'd rather I hooked up with McLaggen ..."[object Object]There was a pause while Harry continued to pound the resilient pod with a trowel. "No, I wouldn't," said Ron, in a very quiet voice. Harry missed the pod, hit the bowl, and shattered it. "Reparo," he said hastily, poking the pieces with his wand, and the bowl sprang back together again. The crash, however, appeared to have awoken Ron and Hermione to Harry's presence. Hermione looked flustered and immediately started fussing about for her copy of Flesh-Eating Trees of the World to find out the correct way to juice Snargaluff pods; Ron, on the other hand, looked sheepish but also rather pleased with himself. "...
  Represent this sentence for searching relevant passages: What does Harry use to destroy the diary in the second book, and how does this object reappear in the seventh book?	Then, without thinking, without considering, as though he had meant to do it all along, Harry seized the basilisk fang on the floor next to him and plunged it straight into the heart of the book. There was a long, dreadful, piercing scream. Ink spurted out of the diary in torrents, streaming over Harry's hands, flooding the floor. Riddle was writhing and twisting, screaming and flailing and then -[object Object]He had gone. Harry's wand fell to the floor with a clatter and there was silence.	For a moment he thought she was going to scream at him. Then she said, in her softest, most sweetly girlish voice, "Come here, Mr. Potter, dear." He kicked his chair aside, strode around Ron and Hermione and up to the teacher's desk. He could feel the rest of the class holding its breath. He felt so angry he did not care what happened next. Professor Umbridge pulled a small roll of pink parchment out of her handbag, stretched it out on the desk, dipped her quill into a bottle of ink, and started scribbling, hunched over so that Harry could not see what she was writing. Nobody spoke. After a minute or so she rolled up the parchment and tapped it with her wand; it sealed itself seamlessly so that he could not open it. "Take this to Professor McGonagall, dear," said Professor Umbridge, holding out the note to him. He took it from her without saying a word and left the room, not even looking back at Ron and Hermione, and slamming the classroom door shut behind him.

• Loss: TripletLoss with these parameters:
  json

  1{ 2 "distance_metric": "TripletDistanceMetric.COSINE", 3 "triplet_margin": 0.3 4}

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: steps
• per_device_train_batch_size: 3
• per_device_eval_batch_size: 3
• num_train_epochs: 5
• fp16: True
• batch_sampler: no_duplicates
• multi_dataset_batch_sampler: round_robin

All Hyperparameters

Training Logs

Framework Versions

• Python: 3.10.12
• Sentence Transformers: 4.0.1
• Transformers: 4.50.3
• PyTorch: 2.6.0+cu124
• Accelerate: 1.5.2
• Datasets: 3.5.0
• Tokenizers: 0.21.1

Citation

BibTeX

Sentence Transformers

TripletLoss