SentenceTransformer based on BAAI/bge-m3

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: BAAI/bge-m3
• Maximum Sequence Length: 8192 tokens
• Output Dimensionality: 1024 dimensions
• Similarity Function: Cosine Similarity
• Supported Modality: Text

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'transformer_task': 'feature-extraction', 'modality_config': {'text': {'method': 'forward', 'method_output_name': 'last_hidden_state'}}, 'module_output_name': 'token_embeddings', 'architecture': 'XLMRobertaModel'})
  (1): Pooling({'embedding_dimension': 1024, 'pooling_mode': 'cls', 'include_prompt': True})
  (2): Normalize({})
)

Usage

Direct Usage (Sentence Transformers)

Evaluation

Metrics

Information Retrieval

• Dataset: arcanum-test
• Evaluated with InformationRetrievalEvaluator

Training Details

Training Dataset

Unnamed Dataset

• Size: 912 training samples
• Columns: anchor, positive, and negative
• Approximate statistics based on the first 912 samples:

  	anchor	positive	negative
  type	string	string	string
  details	min: 5 tokens mean: 9.62 tokens max: 19 tokens	min: 15 tokens mean: 180.92 tokens max: 1044 tokens	min: 15 tokens mean: 246.84 tokens max: 1044 tokens

• Samples:

  anchor	positive	negative
  kill king caladon guide	Kill the King of Caladon. After talking with Mr Willoughsby, a man, Heinrich Jenks appears in the room outside. He wants you to assassinate the King Of Caladon, he tells you to meet Vernon in the Kitchen for more details. When the job is done he will meet you again in Grant’s Tavern and give you 20,000 gold.You can tell Mr Willoughsby and he will send Lorham, his bodyguard to deal with him (this botches the quest).Travelling to Caladon, you need to talk with Renard first and then you will find Vernon who gives you a key.You can also get into the palace by hiding in a crate on the Caladon waterfront.Upstairs you will find a guard patrolling, he will try and kill you on sight (getting past him depends on your style prowling and backstab work well here). Make sure you loot the rooms as there is a lot of jewellery. Go through the ventilation system and explore.It is worthwhile making your way to the treasure vault. The door can be difficult to pick (or break down without damaging weapons)....	The Main Quest. Getting Information at P. Schuyler and Sons. P. Schuyler and Sons is at 44 Devonshire Way. Inside you find James Kingford who fobs you off. To continue, you can: Kill him, quick and messy Pick pocket his key Convince him that you belong to the Tarant Authorities and he needs to cooperate (which can lead to his death) You can then use it to go down the trapdoor in the back room. This leads to a room full of zombies and some random treasure. Once the zombies are dispatched, you can go down the next trapdoor. This leads to a tunnel with even more zombies and traps. Go down the next trapdoor. Here you will find a dwarven tomb. You will find the Schuylers here. To get the information you require you can Kill them all, find they key and open the wood chest Use your pick pocket skill to get the key Come to an agreement with them to get the information (this will annoy Magnus) Use you pick locks skill to open the wood chest. In the end, you find that the ring belongs to Gilbert...
  gambliing quest walkthrough	Skill mastery quest. Gambling mastery. Gamble with Gurin Rockharrow. Women are refused entry to the Gentlemen's Club, but they still have a few avenues: Pick Pocket the key from the doorman Use Unlocking Cantrip to unbar the door Find out the name of the Club Owner from the doorman, getting his address from the Hall of Records, and then paying him a visit Once you meet with Wendell Wellington the options branch further: Pay a bribe and sleep with him for a special invitation Pick Pocket the invite Kill him and his bodyguard and loot his corpse for the invite With 8 points (2 ranks) of melee, you can threaten him for it With 4 points (1 rank) of persuasion and a Reaction Modifier of 81 you can sweet talk him for it Using this invitation will allow a lady to come and go as she pleases	Skill mastery quest. Persuasion mastery. Negotiations with Caladon. Willoughsby will comment about Orator of Ashbury reputation from the quest Monument Planning. Willoughsby will remain in Caladon for the rest of the game. The City Hall dialogue will be inaccessible, making it impossible for Sebastian to appear in The Boil. If the copy of the Agreement is somehow lost, the living one can still report its content to Willoughsby. After the negotiations are completed, independently of the result, King Farad will be "Leaving immediately for Tarant" and disappear; furthermore, the quest will be botched if the King is killed. Making it mutually exclusive with Assassinate King Farad of Caladon. There is a cut outcome left in the game code. If Tarant's counter was lower or equal to 1, currently an impossible result, Willoughsby would have been furious and wouldn't have given a reward,
  where is the key for big warehouse	Rid Mr. Plough's Warehouses of Rats. Talk to Simon Plough at the warehouse entrance and ask about his problem. Visit the smaller warehouse to the left first and kill the rats inside. You will also find a key in one of the barrels. Use the key to enter the bigger warehouse and kill everything inside. Return to Simon to finish the quest.	Find Vegard's Family Heirloom. Receive the quest from Vegard MoltenFlow. Go down into The Dredge. You will eventually come across a room to the right side of a tunnel. The heirloom is in an unlocked chest inside, but the door leading inside is locked. You can either... Navigate through the dark parts of the Dredge further ahead and find the key to the door lying on the ground. Destroy the door or pick its lock. Return the heirloom to Vegard to receive your rewards.

• Loss: GISTEmbedLoss with these parameters:
  json

  1{ 2 "guide": "SentenceTransformer('BAAI/bge-m3')", 3 "temperature": 0.07, 4 "margin_strategy": "absolute", 5 "margin": 0.0, 6 "contrast_anchors": true, 7 "contrast_positives": true, 8 "gather_across_devices": false 9}

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: steps
• per_device_train_batch_size: 16
• per_device_eval_batch_size: 16
• gradient_accumulation_steps: 4
• learning_rate: 1e-05
• weight_decay: 0.01
• num_train_epochs: 1
• lr_scheduler_type: cosine
• warmup_steps: 0.1
• batch_sampler: no_duplicates

All Hyperparameters

Training Logs

Training Time

• Training: 6.3 minutes
• Evaluation: 2.3 seconds
• Total: 6.3 minutes

Framework Versions

• Python: 3.12.13
• Sentence Transformers: 5.4.0
• Transformers: 5.0.0
• PyTorch: 2.10.0+cu128
• Accelerate: 1.13.0
• Datasets: 4.0.0
• Tokenizers: 0.22.2

Citation

BibTeX

Sentence Transformers

GISTEmbedLoss