MPNet base trained on GooAQ triplets using MultipleNegativesBidirectionalRankingLoss with hard negatives

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: microsoft/mpnet-base
• Maximum Sequence Length: 512 tokens
• Output Dimensionality: 768 dimensions
• Similarity Function: Cosine Similarity
• Training Dataset:
  • gooaq-hard-negatives
• Language: en
• License: apache-2.0

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False, 'architecture': 'MPNetModel'})
  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
)

Usage

Direct Usage (Sentence Transformers)

Evaluation

Metrics

Information Retrieval

• Dataset: gooaq-dev
• Evaluated with InformationRetrievalEvaluator

Training Details

Training Dataset

gooaq-hard-negatives

• Dataset: gooaq-hard-negatives at 87594a1
• Size: 99,000 training samples
• Columns: question, answer, negative_1, negative_2, negative_3, negative_4, and negative_5
• Approximate statistics based on the first 1000 samples:

  	question	answer	negative_1	negative_2	negative_3	negative_4	negative_5
  type	string	string	string	string	string	string	string
  details	min: 8 tokens mean: 11.8 tokens max: 24 tokens	min: 13 tokens mean: 59.53 tokens max: 149 tokens	min: 13 tokens mean: 58.38 tokens max: 135 tokens	min: 13 tokens mean: 58.34 tokens max: 128 tokens	min: 13 tokens mean: 59.23 tokens max: 131 tokens	min: 13 tokens mean: 59.02 tokens max: 122 tokens	min: 14 tokens mean: 59.23 tokens max: 183 tokens

• Samples:

  question	answer	negative_1	negative_2	negative_3	negative_4	negative_5
  will acrylic paint stick to polyester?	I recommend acrylic because polyester is a manmade fabric and acrylic is a water-based paint. Oil paints contain solvents. ... You could also use acrylic paint markers with good results. If you are painting on fabric you might want to spray it with some kind of protective coat after it's set for a few day.	Acrylic resin (but not acrylic emulsion, which is the basis of acrylic paint) is a thermoplastic, which means it is one of a group of plastics which can be heated and manipulated repeatedly, whereas polyester resin and epoxy are thermosetting plastics, which use heat or a catalyst to solidify into a solid mass that won ...	Acrylic paint is ideal on foam core because you do not need to use solvents like with oil paints. Acrylic it fast-drying, durable and adheres to most surfaces. It also has an even sheen and does not need a base coat.	The short answer is no, house paint does not generally perform as well as artists' acrylics in terms of durability, lightfastness and appearance. ... Vehicles and binders used in house paints vary from one manufacturer to another, but usually the term “latex” or “acrylic latex” is used to describe the polymer base.	Acrylics are synthetic paints designed to mix and blend just like oils. Acrylic paint dries extremely fast, to the extent it will dry on your palette if you do not use the paint quick enough. It is less forgiving in this manner and you must be decisive when you paint.	You can paint acrylic paint over enamel paint, but only with proper surface preparation. If you just apply a coat of water-based paint, it won't adhere properly on the surface and the colour will fade quickly. That's because the sheen of the enamel paint interferes with the acrylic paint.
  what is the difference between zone 6 and zone 6a?	Subset Zone Temperatures Each gardening zone is divided into two subsets; zone 6 subsets are 6a and 6b. ... Zone 6: This zone has a minimum average of temperatures of -10° to 0°F. Zone 6a: This subzone has a minimum average temperature of -10° to -5° F. Zone 6b: This subzone has a minimum average temperature of -5° to 0°F.	The zone 2 feature allows this receiver to send a second source signal to a separate audio system in another location. For example, you can watch a DVD in the main zone, while others can listen to a CD in zone 2 at the same time. ... An additional audio system (for example, an amplifier) to output the sound in zone 2.	The only difference is the size - Zone 1 measures 43cm, the 2 is 60 - and the further north you live the more likely you are to need the larger.	Zone C may have ponding and local drainage problems that don't warrant a detailed study or designation as base floodplain. Zone X is the area determined to be outside the 500-year flood and protected by levee from 100- year flood.	The USDA Hardiness Zone Map divides North America into 11 separate planting zones; each growing zone is 10°F warmer (or colder) in an average winter than the adjacent zone. If you see a hardiness zone in a gardening catalog or plant description, chances are it refers to this USDA map.	Forward Lookup Zones—Forward Lookup Zones allow the DNS Server to resolve queries where the client sends a name to the DNS Server to request the IP address of the requested host.
  what is the working principle of electroscope?	The principle of an electroscope is based on the atomic structure of elements, the internal structure of metal elements, charge induction, and the idea that like charges repel and opposite charges attract. All elements are composed of electrons, protons, and neutrons - with the electrons surrounding the nucleus.	Detecting EM Waves. To detect the electric fields, use a conducting rod. The fields cause charges (generally electrons) to accelerate back and forth on the rod, creating a potential difference that oscillates at the frequency of the EM wave and with an amplitude proportional to the amplitude of the wave.	['Head/Body houses the optical parts in the upper part of the microscope.', 'Base of the microscope supports the microscope and houses the illuminator.', 'Arm connects to the base and supports the microscope head.']	Handheld and benchtop equipment such as electronic meters are available to test parameters including pH, turbidity (the amount of particulate suspended in a liquid), and electrical conductivity.	Electronystagmography (ENG or electrooculography) is used to evaluate people with vertigo (a false sense of spinning or motion that can cause dizziness) and certain other disorders that affect hearing and vision. Electrodes are placed at locations above and below the eye to record electrical activity.	What is the working principle of magnetic flow meter? Faraday's Law The operation of a electromagnetic flowmeter is based upon Faraday's Law, which states that the voltage induced across any conductor as it moves at right angles through a magnetic field is proportional to the velocity of that conductor.

• Loss: MultipleNegativesBidirectionalRankingLoss with these parameters:
  json

  1{ 2 "temperature": 0.01, 3 "similarity_fct": "cos_sim", 4 "gather_across_devices": false 5}

Evaluation Dataset

gooaq-hard-negatives

• Dataset: gooaq-hard-negatives at 87594a1
• Size: 1,000 evaluation samples
• Columns: question, answer, negative_1, negative_2, negative_3, negative_4, and negative_5
• Approximate statistics based on the first 1000 samples:

  	question	answer	negative_1	negative_2	negative_3	negative_4	negative_5
  type	string	string	string	string	string	string	string
  details	min: 8 tokens mean: 11.56 tokens max: 22 tokens	min: 15 tokens mean: 60.49 tokens max: 183 tokens	min: 15 tokens mean: 58.66 tokens max: 165 tokens	min: 15 tokens mean: 59.37 tokens max: 159 tokens	min: 14 tokens mean: 59.7 tokens max: 159 tokens	min: 14 tokens mean: 58.75 tokens max: 141 tokens	min: 14 tokens mean: 59.91 tokens max: 141 tokens

• Samples:

  question	answer	negative_1	negative_2	negative_3	negative_4	negative_5
  is aiims and jipmer cancelled for 2020?	According to the above-mentioned clause, the AIIMs and JIPMER medical entrances have been scrapped and the admissions will be conducted under NEET. ... The National Testing Agency will be conducting the NEET 2020 examination on May 3, 2020, in the pen and paper mode.	Okeechobee Music and Arts Festival has been canceled for 2019. ... After months of radio silence from the Okeechobee Music and Arts Festival, organizers announced on Thursday afternoon that the 2019 gathering has been canceled, but say it will return in March 2020.	Update: 2020 Minneapolis Summer X Games Cancelled April 24th, 2020: Due to the ongoing COVID-19 concerns, ESPN has announced X Games Minneapolis 2020, originally scheduled for July 17-19, has been cancelled. Please visit the Official X Games website for more information.	New episodes will air at least until September 2020. But that doesn't mean the series is canceled. Chandler Massey, who portrays Will Horton on "Days," took to Twitter following the news to assure fans that the daytime soap opera isn't going anywhere. "We're not being cancelled," he tweeted Tuesday.	New Delhi: Confirming that All India Institute of Medical Sciences (AIIMS) entrance will be merged with National Eligibility cum Entrance Test (NEET) from 2020-21 onwards, the Union Minister of State of Health and Family welfare stated that the move will ensure a common standard of medical education in the country and ...	iZombie was renewed for a third season on March 11, 2016. iZombie was renewed for a fourth season on May 10, 2017, which premiered on February 26, 2018. iZombie was renewed for a fifth and final season on May 2018, which premiered on May 2, 2019.
  vs_installershell.exe has an invalid certificate vs 2019?	Probably due to a pending Windows update not being installed. ... Please go to windows update and make sure all pending windows update are installed and reboot the computer, then go to C:\Program Files (x86)\Microsoft Visual Studio\Installer then run vs_installershell.exe as administrator.	This issue may occur if one or more of the following condition are true: The computer's date and time settings are incorrect. The certificate has expired or is not yet valid.	This issue may occur if one or more of the following condition are true: The computer's date and time settings are incorrect. The certificate has expired or is not yet valid.	['Click Start > Run.', 'Type in MMC and click OK.', 'Go into the File Tab (or Console) > select Add/Remove Snap-in.', 'Click Add > Click Certificates and click Add, then click close.', 'Click OK (in the Add/Remove Snap-in window)', 'Select Computer Account.', 'Select Local Computer.', 'Click the + to expand the Certificates console tree.']	['Click Start > Run.', 'Type in MMC and click OK.', 'Go into the File Tab (or Console) > select Add/Remove Snap-in.', 'Click Add > Click Certificates and click Add, then click close.', 'Click OK (in the Add/Remove Snap-in window)', 'Select Computer Account.', 'Select Local Computer.', 'Click the + to expand the Certificates console tree.']	['Use certmgr. msc command inside Run dialog. Press Win+R keys -> type certmgr. ... ', 'Use Windows 10 to open the certificate. You can also simply double-click your . crt file in order for Windows to open it. ... ', 'Open . crt file inside your favorite browser. Right-click on the .']
  do you get your period on depo?	Many women stop having their menstrual periods after about 6-12 months of getting Depo-Provera® injections. This is no reason to worry. It's not a medical problem and it does not mean you are pregnant. It just means that your ovaries are resting, and the lining of your uterus does not grow.	Many women stop having their menstrual periods after about 6-12 months of getting Depo-Provera® injections. This is no reason to worry. It's not a medical problem and it does not mean you are pregnant. It just means that your ovaries are resting, and the lining of your uterus does not grow.	You will get your menstrual period back within 6-18 months after you stop taking the Depo-Provera® injections.	You will get your menstrual period back within 6-18 months after you stop taking the Depo-Provera® injections.	You will get your menstrual period back within 6-18 months after you stop taking the Depo-Provera® injections.	It's not a medical problem and it does not mean you are pregnant. It just means that your ovaries are resting, and the lining of your uterus does not grow. So there is no menstrual bleeding. You will get your menstrual period back within 6-18 months after you stop taking the Depo-Provera® injections.

• Loss: MultipleNegativesBidirectionalRankingLoss with these parameters:
  json

  1{ 2 "temperature": 0.01, 3 "similarity_fct": "cos_sim", 4 "gather_across_devices": false 5}

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: steps
• per_device_train_batch_size: 32
• per_device_eval_batch_size: 32
• learning_rate: 2e-05
• num_train_epochs: 1
• warmup_ratio: 0.1
• bf16: True
• batch_sampler: no_duplicates

All Hyperparameters

Training Logs

Framework Versions

• Python: 3.11.14
• Sentence Transformers: 5.3.0.dev0
• Transformers: 4.57.3
• PyTorch: 2.9.1+cu130
• Accelerate: 1.12.0
• Datasets: 4.4.2
• Tokenizers: 0.22.2

Citation

BibTeX

Sentence Transformers