SentenceTransformer based on hkunlp/instructor-xl

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: hkunlp/instructor-xl
• Maximum Sequence Length: 128 tokens
• Output Dimensionality: 768 dimensions
• Similarity Function: Cosine Similarity

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 128, 'do_lower_case': False, 'architecture': 'T5EncoderModel'})
  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': False})
  (2): Dense({'in_features': 1024, 'out_features': 768, 'bias': False, 'activation_function': 'torch.nn.modules.linear.Identity'})
  (3): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

Training Details

Training Dataset

Unnamed Dataset

• Size: 17,624 training samples
• Columns: sentence_0 and sentence_1
• Approximate statistics based on the first 1000 samples:

  	sentence_0	sentence_1
  type	string	string
  details	min: 12 tokens mean: 99.0 tokens max: 128 tokens	min: 7 tokens mean: 122.21 tokens max: 128 tokens

• Samples:

  sentence_0	sentence_1
  Represent the plot: PERSON (PERSON), a bookseller, and PERSON (PERSON), a florist, are two old friends living in GPE. Since they're having serious money problems, PERSON comes up with an idea: he decides to become a pimp... but PERSON's pimp! PERSON, after initially finding the idea completely stupid and refusing, is eventually persuaded...	Represent the plot: Dr. PERSON (PERSON), a wealthy dermatologist, mentions to her patient PERSON (PERSON) that she and a woman friend, ORG), wish to experience a ménage à trois and asks if he knows a willing man. PERSON, whose used bookstore has failed as a business, convinces his friend and former employee PERSON (PERSON) to take the gig, as both are short of money. Soon, they build a thriving gigolo trade with PERSON as the pimp. PERSON lives with PERSON (PERSON) and her children, one of whom gets head lice. PERSON takes the boy to PERSON (PERSON), the attractive widow of a Hassidic rabbi, for treatment. PERSON tells PERSON, claiming he's a massage healer who can help her, before taking her to see him. Being too religiously observant to even shake hands with him, she nonetheless allows PERSON to massage her back. That touch, the first in two years since the passing of her husband, brings her to tears. Meanwhile, PERSON (Liev Schreiber), who works for ORG, a GPE, GPE neighborhood patr...
  Represent the plot: After a suicide bombing in the GPE, ORG is tasked with preventing a nuclear attack on American soil. This attack is orchestrated by Arab terrorists, who are prepared to do anything to liberate LOC from Judeo-Western domination. ORG embarks on a new adventure in GPE, GPE, and GPE to save GPE and the world, and to capture PERSON, the leader of the Lebanese-Palestinian terrorists. Before being captured, Kadal entrusts his brother with a mission: to plant an atomic bomb in GPE. ORG then travels to GPE to destroy the fortress	Represent the plot: Terrorist leader PERSON has threatened to bomb GPE, GPE unless western influence is removed from LOC. In order to keep PERSON from detonating an atomic bomb in GPE, ORG, with new leaders PERSON and PERSON, are ordered to team up with a group of Russian Spetsnaz commandos and head to ORG, PERSON's hometown in the fictional country of GPE, so they can hunt for PERSON. PERSON sends PERSON to GPE, with orders to detonate the bomb live on TV, where PERSON arranges for an assault on TV news producer PERSON. Turning up in time to save her, PERSON chases off the attackers and uses the situation to become close to PERSON. With friction between PERSON and PERSON growing, the mission doesn't start well, losing a Soviet team member almost immediately. Eventually they locate and apprehend PERSON, but at a cost, PERSON and PERSON are killed and PERSON is wounded. They learn PERSON has already sent his suicide bomber, PERSON and GPE interrogate PERSON and learn of the bombers iden...
  Represent the plot: Police Commissioner PERSON (PERSON) investigates the suspicious deaths of three high-ranking military officers who apparently committed suicide. Among them is General PERSON. Under pressure from his superiors, investigating magistrate PERSON (PERSON) orders ORG to quickly conclude the investigation. ORG then receives help from his girlfriend, journalist PERSON (PERSON), and an agent of the Italian secret service, PERSON (Tomás Milián), who also has doubts about the official version of the officers' suicides. In a country villa, GPE, a wealthy man, is murdered. Suspicion falls on an escort known as "La Tunisina," who was the last person to see ORG. Located and questioned by ORG, she proclaims her innocence. She claims she escaped because she saw the killer's face. The man will be identified as PERSON, nicknamed GPE. Unfortunately, the woman is later found and strangled by GPE. Commissioner PERSON orders his colleagues (Deputy Commissioner PERSON and Marshal De Luca) ...	Represent the plot: Three army officials are murdered but made to look as if they committed suicide. After wealthy master electrician ORG is found dead, three policemen—Inspector PERSON, Lt. PERSON and Office De Luca—investigate. PERSON and PERSON visit retired madam PERSON, who has connections to ORG, and when they discover she's running a brothel out of her estate, they offer her immunity for information. They go to interrogate ORG's last visitor, ORG—AKA la GPE—only to find she's attempted suicide. At the hospital, they tell her she's the prime suspect and she admits guilt. ORG grows suspicious of her admission and suspects a blackmail plot, and she eventually admits she saw the true killer. PERSON and PERSON keep watch over ORG's villa overnight and witness a man break in and attempt to steal tape recordings. The man, PERSON, is taken into custody and ORG listens to the recordings, which contain a conversation between the murdered General PERSON and a lawyer named GPE, in which ...

• Loss: MultipleNegativesRankingLoss with these parameters:
  json

  1{ 2 "scale": 20.0, 3 "similarity_fct": "cos_sim", 4 "gather_across_devices": false 5}

Training Hyperparameters

Non-Default Hyperparameters

• multi_dataset_batch_sampler: round_robin

All Hyperparameters

Training Logs

Framework Versions

• Python: 3.9.18
• Sentence Transformers: 5.1.2
• Transformers: 4.57.6
• PyTorch: 2.8.0+cu128
• Accelerate: 1.10.1
• Datasets: 4.5.0
• Tokenizers: 0.22.2

Citation

BibTeX

Sentence Transformers

MultipleNegativesRankingLoss