SentenceTransformer based on BAAI/bge-base-en

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: BAAI/bge-base-en
• Maximum Sequence Length: 512 tokens
• Output Dimensionality: 768 dimensions
• Similarity Function: Cosine Similarity
• Training Dataset:
  • json

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': True}) with Transformer model: BertModel 
  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

Evaluation

Metrics

Information Retrieval

• Dataset: dim_768
• Evaluated with InformationRetrievalEvaluator with these parameters:
  json

  1{ 2 "truncate_dim": 768 3}

Information Retrieval

• Dataset: dim_512
• Evaluated with InformationRetrievalEvaluator with these parameters:
  json

  1{ 2 "truncate_dim": 512 3}

Information Retrieval

• Dataset: dim_256
• Evaluated with InformationRetrievalEvaluator with these parameters:
  json

  1{ 2 "truncate_dim": 256 3}

Information Retrieval

• Dataset: dim_128
• Evaluated with InformationRetrievalEvaluator with these parameters:
  json

  1{ 2 "truncate_dim": 128 3}

Information Retrieval

• Dataset: dim_64
• Evaluated with InformationRetrievalEvaluator with these parameters:
  json

  1{ 2 "truncate_dim": 64 3}

Training Details

Training Dataset

json

• Dataset: json
• Size: 3,019 training samples
• Columns: positive, anchor, and negative
• Approximate statistics based on the first 1000 samples:

  	positive	anchor	negative
  type	string	string	list
  details	min: 14 tokens mean: 198.49 tokens max: 413 tokens	min: 8 tokens mean: 19.28 tokens max: 41 tokens	size: 5 elements

• Samples:

  positive	anchor	negative
  First Information Report: Officer Thanadhiksh Thahbarpur Ajmer respectfully submits that the petitioner Manju Yadav states that my husband Santosh Yadav, son Sw. Harikesh Yadav, brother-in-law Mayank Yadav, son Sw. Heetikesh Yadav, and mother-in-law Radhika, wife of Sw. Harikesh Yadav, these three people have beaten me together. If the villagers had not intervened, these three would have killed me and my son. The constant intention of my mother-in-law Radhika, wife of Sw. Harikesh Yadav, is to beat me to death. My husband Santosh Yadav and brother-in-law Mayank Yadav have been indecent with me. My husband cut off my ear while my brother-in-law Mayank Yadav tore my sari and tried to undress me, which is why I was trying to protect myself with bricks. If the villagers had not intervened, these people would have undressed and killed me. These three come every day asking for dowry from me and beat me, insult me, and abuse me. There is a danger to my life and my son's life from these three	Who are the three individuals mentioned in the report who have beaten Manju Yadav?	["for firing. An ejector is attached at the back of the barrel for loading and unloading the cartridge. The body and trigger are joined together with a steel plate. The seized cartridge is of 315 bore, made of brass, with 'KF 8 MM' written on its base. The accused's actions fall under the offense punishable under Section 3/25A Act. At around 10:45 PM, he was taken into custody and informed of the charges. Due to the sudden occurrence in an isolated area, no witnesses were available. During the arrest and seizure, strict adherence to the orders and directives of the High Court and Human Rights Commission was maintained. An arrest memo was prepared, and the accused's arrest was communicated to his brother Jitendra Rajput at mobile number 9695404597. The seized caliber and cartridge were sealed in the clothes they were found in and stamped with a seal, and a sample stamp was prepared. The report was written and read out in the light of the torch, and signatures of all concerned were", "rights were fully followed. An arrest memo was prepared, and notice of the arrest will be given to the accused's relatives at the police station. The report was read out to the accused on the spot for signature as evidence. SD HC Manoj SD Hindi Sovinder Kumar SD HC Aditya SD HC Balkishan SD English Unreadable Karmanvir Up NI Thana SI Line Munger 9.3.24 Note: A copy of the report was given to the accused, and fingerprints were taken. Signature Thumbprint Dilshad SD English Unreadable Karmanvir Up NI Thana SI Line District Mujjafarnagar Date 9.3.2024 Note: I hereby certify that the above report was copied by me. 4 N.C R.B (N.C.R.B)
  First Information Report: Officer Thanadhiksh Thahbarpur Ajmer respectfully submits that the petitioner Manju Yadav states that my husband Santosh Yadav, son Sw. Harikesh Yadav, brother-in-law Mayank Yadav, son Sw. Heetikesh Yadav, and mother-in-law Radhika, wife of Sw. Harikesh Yadav, these three people have beaten me together. If the villagers had not intervened, these three would have killed me and my son. The constant intention of my mother-in-law Radhika, wife of Sw. Harikesh Yadav, is to beat me to death. My husband Santosh Yadav and brother-in-law Mayank Yadav have been indecent with me. My husband cut off my ear while my brother-in-law Mayank Yadav tore my sari and tried to undress me, which is why I was trying to protect myself with bricks. If the villagers had not intervened, these people would have undressed and killed me. These three come every day asking for dowry from me and beat me, insult me, and abuse me. There is a danger to my life and my son's life from these three	What actions did Manju Yadav's husband Santosh Yadav and brother-in-law Mayank Yadav take against her?	['First Information Report: On receiving information, two batches of illegal raw liquor totaling 18 liters were seized, and one person was arrested under Section 60(1) EX Act at Badosaray Police Station, Barabanki district on April 4, 2024. I, Sub-Inspector Salik Ray, along with Vinay Kumar Verma, Alauk Pandey, and Deepak Kumar, set out from Thanha Hajja towards Baraulia Chauraha Cafekirav where suspicious individuals and vehicles were reported. We were discussing measures to curb the production and sale of raw liquor when an informant approached and informed us that a man carrying raw liquor in both hands was heading towards Kotwa Dhama via Amara Katohra Road towards Sita Devi Mahavidyalaya. Believing the information, we proceeded to the location indicated by the informant along with Inspector Sanjay Singh and Excise Inspector Shivani Singh Chauhan. As we turned towards Sita Devi 3 NC RB (NCRB) I.L.F.-I (Unified Investigation Form - I), we headed towards Sita Devi School. After', "First Information Report: During the course of duty, one illegal chaku was seized and one person was arrested under Section 425 Arms Act on the date 30.01.24. Today, I, No. 2079 Anmol Kumar May Hana Rahi, along with No. 2031 Shravan Kumar Chita 11, were posted and conducting an investigation and search request letter stoppage crime jail Tamil Chauki area when we, the employees, reached the Karakala Tiraha while patrolling, a special informant came to us and informed that a person who has an illegal chaku is sitting near the back wall of the small minaret and can be caught quickly if we hurry. We, the police, believing the informant's information, tried to get testimony from the people coming and going, but due to good or bad reasons, no one was willing to testify and left without giving their name and address. Then we, the police, searched each other's clothes and believed that we did not have any item related to the crime. Subsequently, we, the police, went to the place indicated by", "First Information Report: Counterfeit Case --- Seizure Report 18 bottles of country liquor and arrest of one person under Section 60 Ex Act PS Eagles Road Aligarh on today's date 17/3/24 by SI Jitendra Kumar we were checking suspicious individuals and vehicles in the police station area on Sasni Road when we were checking at Kaka Chowk, a person coming from the Eagles direction showed a plastic bag in his hand. Suspecting something, we stopped him and signaled with a torch light to stop, but he quickly started running back towards Eagles. Suspecting further, we chased him and caught him on Main Road near Eagles, about 20 steps away from Kaka Chowk at 22:30 hours. After searching him, we found 3 NC RB (N.C.R.B.) I.L.F.-I (Unified Investigation Form - I) and questioned him. He gave his name as Lal Singh, son of Gopali Ram, from village Nagla Ahivasi, Police Station Eagles Aligarh. Checking the bag in his hand, we found 13 bottles of Joshila country liquor (spiced) (quantity 200 ml) and 5", "Urmila Devi's wife Vidyadhara killed her and burned her body in the house to hide the truth. Kanhaya Lal first asked the petitioner to come to Azamgarh, then said to come to Tahbarpur, and then cut off the phone. The petitioner is giving this information. Therefore, it is requested that the FIR be registered and legal action be taken against the accused persons. Date 18.03.2024, Petitioner Sudip Yadav's son Madhuban Yadav, Gram Pashchim Patti, Thana Ahiraula, Janpad Azamgarh, signature Sudipyadav HMICM, case registered according to rules, signature illegible, Thana Adhyaksh Thana Tahbarpur, date 18.03.2024, Note verified that the copy of the document was dictated by me HEMU Anand Kumar Maurya on the CCTNS portal and typed word for word by HEMU Ram Kumar, additionally those words which were unclear.", "the railway bridge after about 50 steps at around 4:30 PM. When questioned, he identified himself as Sumit Kumar Saini, son of Rajesh Kumar, aged about 20 years, from Shahjahanpur district. In his right hand, we found a plastic container with a bottle inside containing a brownish substance. Upon opening the bottle, we smelled raw alcohol. The seized raw alcohol license was not shown when requested. The bottle was sealed on the spot and a sample seal was prepared. During the arrest, orders of the Supreme Court and Human Rights Commission were followed to treat the accused fairly. The seized goods and accused were taken into police custody. Due to the sudden arrest near the railway and public inconvenience, no witnesses were available. The FIR will be communicated to the accused's relatives upon arrival at the police station. The report was dictated and written by 02025 Rohit Kumar and signed by 02710 Gaurav Kumar at Sadar Bazaar Police Station, Shahjahanpur, on January 5, 2024. A copy"]
  to my life and my son's life from these three people. Therefore, I request you to grant justice. Petitioner Manju Yadav, husband Santosh Yadav, village Sikandarpur, post Dharmdaspur, Nawada district-Ajmer, mobile number-8423229252, date-16/02/2024 HMICM 4 N.C R.B (N.C.R.B). I.F.- (Unified Investigation Form-l) Register the case according to the rules. Signature illegible, Thanadhiksh Officer 16.2.2024	Where does the petitioner Manju Yadav reside?	['Mobile-9517003259, 83188106881 Note- I, Prabhat Kumar 3 NC RB (N.C.R.B) I.L.F.-1 (Unified Investigation Form -1) certify that the document was fed exactly as spoken by me on the computer.', 'given by the informant who then left. With the help of the Leopard team, the suspect was apprehended along with the cow at the edge of the highway near Matlupur Crossing. When questioned about his name and address, he stated his name as Kariman alias Ajay son of Kishor, residing in Ranee Thana Dakshinatola, district Maunath Bhanjan, approximately 27 years old. He was asked about the cow he was carrying, which was tied with a rope of about four feet, and he started to act suspiciously. Upon further questioning, he admitted that since vehicles carrying cows were often caught by the animal police, he had been transporting cows on foot up to Badhua Godam Border and then sending them to Bihar for slaughter. He said it was his misfortune today that he was caught by us. He claimed to be a poor man with no other means of livelihood and supported his family with this income. He requested forgiveness and promised to stop this work. The seized cow has the following characteristics: one healthy', "First Information Report: The complaint letter is written in Hindi and is final. In service, Mr. Thana Adhyaksh Gajipur Indiranagar Lucknow, it is informed that the applicant Shah Nawaz Ansari SIO Tahir Ansari is a resident of Amraai Village Indiranagar Lucknow. I came to read at Prime Plaza Library Munshi Pulia on today's date 06/03/2024 from 11:30 AM to 9:00 PM. My vehicle (Vehicle No.) UP 32 HY 7715, which was white in color, was found missing from the place after a thorough search, and no information was obtained. Therefore, it is requested that Mr. Ji kindly search for my vehicle. It would be a great favor. Date 06/03/2024 Thank you Applicant signature readable in English Shahnwaz Shah Nawaz Ansari SLO Tahir Ansari Address Amraai Village Indiranagar Lucknow Mobile No. 8853832907 Note: The above complaint was made by Vijay Kumar Tiwari with registration number 7498 and FIR was registered based on his statement by Shrikanth Tiwari (Additional technical error).", "information, I, the responsible inspector May Hamarahee, went to Shyam Singh's house near Thanha Village. I secretly verified the location and prepared a map before obtaining a search warrant from the Deputy Superintendent of Police Patiala Jan. Kasganj. After receiving the search warrant, I summoned SI Kalyan Singh and Kan. 07 Abhlaash Ch and Kan. 678 Kuldeep Kumar, gave necessary directions, and brought them to the Thanha Village site. I informed everyone about the incident and conducted a body search on the spot to ensure no related items were with us. Subsequently, I, the responsible inspector May Police Force, approached Shyam Singh's house and stood quietly near the door listening, hearing 99 pao being played. This confirmed to me that illegal gambling was taking place inside the house. Then, I entered Anil Gupta's house with May Hamrahee Force, and upon seeing us, the people inside started running around the room. At approximately 21:10, all were arrested using necessary force.", 'given to the accused. SD Order Kumar, SD No. 293 Kumar, SD Illegible SI 22/3/24 (Dhirendra Singh) Note: I, SD No. 594 Kapin Kumar, certify that the copy of the report was made word for word by me. SD No. 594 Kapin Kumar 4 N.C R.B (NCRB)

• Loss: MatryoshkaLoss with these parameters:
  json

  1{ 2 "loss": "MultipleNegativesRankingLoss", 3 "matryoshka_dims": [ 4 768, 5 512, 6 256, 7 128, 8 64 9 ], 10 "matryoshka_weights": [ 11 1, 12 1, 13 1, 14 1, 15 1 16 ], 17 "n_dims_per_step": -1 18}

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: epoch
• per_device_train_batch_size: 32
• per_device_eval_batch_size: 16
• gradient_accumulation_steps: 8
• learning_rate: 2e-05
• num_train_epochs: 50
• lr_scheduler_type: cosine
• warmup_ratio: 0.1
• bf16: True
• tf32: True
• load_best_model_at_end: True
• optim: adamw_torch_fused
• batch_sampler: no_duplicates

All Hyperparameters

Training Logs

• The bold row denotes the saved checkpoint.

Framework Versions

• Python: 3.10.12
• Sentence Transformers: 4.1.0
• Transformers: 4.52.2
• PyTorch: 2.6.0+cu124
• Accelerate: 1.7.0
• Datasets: 3.6.0
• Tokenizers: 0.21.1

Citation

BibTeX

Sentence Transformers

MatryoshkaLoss

MultipleNegativesRankingLoss