SentenceTransformer based on nomic-ai/modernbert-embed-base

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: nomic-ai/modernbert-embed-base
• Maximum Sequence Length: 8192 tokens
• Output Dimensionality: 768 dimensions
• Similarity Function: Cosine Similarity

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 8192, 'do_lower_case': False, 'architecture': 'ModernBertModel'})
  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

Training Details

Training Dataset

Unnamed Dataset

• Size: 3,016 training samples
• Columns: anchor, positive, and negative
• Approximate statistics based on the first 1000 samples:

  	anchor	positive	negative
  type	string	string	string
  details	min: 66 tokens mean: 170.03 tokens max: 403 tokens	min: 21 tokens mean: 69.6 tokens max: 180 tokens	min: 31 tokens mean: 84.68 tokens max: 217 tokens

• Samples:

  anchor	positive	negative
  The Manager (Flight Operations) plans, directs and coordinates flight operations in order to ensure flights run efficiently and safely in accordance with established rules and regulations. He/She is involved in the management of aircraft data systems and the administration of the Operations Control Centre (OCC). He develops plans and proposes changes to enhance flight control operations. During irregular operations, he is responsible for activating the emergency response plans and communicating contingency plans to the airport stakeholders and authorities. He identifies safety and/or security risks and develops plans to mitigate them. He also has overall accountability for assessment and selection of new team members. He forges partnerships and cultivates close working relationships with airport agencies, authorities, customers and vendors. The Manager (Flight Operations) has exceptional leadership and communication skills so as to lead and communicate with a wide range of stakeholders...	Flight Operations Manager oversees and coordinates all aspects of flight operations to ensure safety and efficiency, managing aircraft data systems and the Operations Control Centre. Responsible for developing operational plans, implementing emergency response strategies, and communicating with airport authorities and stakeholders. The role requires strong leadership, exceptional communication skills, and the ability to foster teamwork while managing safety risks and operational challenges.	Junior Safety Officer monitors and evaluates workplace safety protocols to ensure compliance with health regulations and standards. He/She is responsible for conducting safety audits, reporting hazards, and implementing safety training programs. The role involves collaborating with various departments to enhance safety measures, managing incident reports, and maintaining safety data systems. Strong communication skills and the ability to work under pressure are essential for effective coordination with staff and regulatory agencies.
  The Assistant Front Office Manager/Assistant Operations Manager/Duty Manager/Guest Relations Manager/Guest Services Manager manages the daily operations of the front office to ensure efficient functioning of the team in accordance with the department's operating procedures and service standards. He/She develops operations plans, monitors room inventory and collaborates with other departments on special guest arrangements. He also manages personalised reception services for VIP guests, implements loyalty programmes and identifies and resolves deviations and irregularities in service operations. To drive service excellence, he manages the team's service performance, oversees service recovery and interacts with guests to build guest relationships and gather service feedback. He also reviews systems and processes, comes up with new ideas and implements sustainability programmes. He manages operational risks through compliance management, crisis management and loss and risk prevention. His ...	Assistant Front Office Manager responsible for overseeing daily front office operations, ensuring team efficiency, developing operational plans, managing room inventory, and enhancing guest relations through personalized services and loyalty programs while maintaining service excellence and compliance.	Junior Risk Management Analyst needed to support the identification and assessment of potential risks within the financial sector. This role involves analyzing data to develop risk mitigation strategies, collaborating with various departments to ensure compliance with regulations, and preparing reports on risk assessments. The ideal candidate will have strong analytical skills, attention to detail, and the ability to work under pressure. Experience in financial modeling and risk analysis is preferred. This position requires working standard office hours with occasional overtime.
  The Ground Services Officer is responsible for the delivery of quality passenger services through providing assistance to passengers and addressing their queries. He/She communicates and monitors service standards of ground handling agents. He mentors and trains ground handling agents and ensures compliance with established standards. He follows up with passengers safety and security concerns and queries. In the event of flight disruptions or delays, he provides assistance to passengers. The Ground Services Officer is customer-centric and provides excellent service to the customers and passengers. He is comfortable with face-to-face interactions with the various stakeholders whilst working in shifts. He possesses adequate computer literacy in order to obtain real-time flight information and access the reservation and booking systems. Furthermore, he has good communication and interpersonal skills which allow him to work effectively in a team and execute expected service standards of th...	Ground Services Officer responsible for delivering exceptional passenger assistance and addressing inquiries while ensuring compliance with service standards. Mentors ground handling agents and manages safety and security concerns, providing support during flight disruptions. Strong customer service focus with excellent communication skills and computer literacy for real-time flight information access.	Junior Risk Management Analyst responsible for evaluating financial risks and developing mitigation strategies within the healthcare sector. The role involves analyzing data to identify potential threats, preparing risk assessment reports, and collaborating with cross-functional teams to enhance compliance with regulatory standards. Candidates should possess strong analytical skills and the ability to communicate findings effectively.

• Loss: MultipleNegativesRankingLoss with these parameters:
  json

  1{ 2 "scale": 20.0, 3 "similarity_fct": "cos_sim" 4}

Evaluation Dataset

Unnamed Dataset

• Size: 754 evaluation samples
• Columns: anchor, positive, and negative
• Approximate statistics based on the first 754 samples:

  	anchor	positive	negative
  type	string	string	string
  details	min: 57 tokens mean: 169.51 tokens max: 349 tokens	min: 23 tokens mean: 69.15 tokens max: 184 tokens	min: 31 tokens mean: 83.26 tokens max: 220 tokens

• Samples:

  anchor	positive	negative
  The Installation, Inspection and Servicing Senior Technical Officer conducts site inspections and investigations on gas equipment installations and proposes solutions to customers for gas installation non-compliance issues. He/She supervises contractors on day-to-day operations to ensure compliance with Codes of Practice, regulatory and, project requirements, and leads the servicing of gas installations and commissioning of gas appliances. He prepares technical specifications for tender contracts, and builds internal capabilities through on-the-job training. He works at customers' sites, including domestic, commercial and industrial buildings and is therefore required to have a high awareness of safety. He is meticulous, systematic, and a good problem solver, able to propose solutions to customers with gas pipe infringements. He is a good team player and interacts effectively with team members and customers.	Senior Technical Officer for Gas Installation Oversight and Compliance, responsible for conducting site inspections, supervising contractors, and providing solutions for gas installation issues while ensuring adherence to safety standards and regulatory requirements.	Junior Risk Management Analyst responsible for evaluating potential risks in financial operations, conducting audits, and developing mitigation strategies. This role involves preparing detailed reports on risk assessments, collaborating with various departments to ensure compliance with industry regulations, and implementing training programs to enhance team awareness of risk management practices.
  The Head Chef is the overall in-charge for the kitchens daily operations to guide preparation of food across all workstations. He/She supervises day-to-day operations of the kitchen and creates new recipes and menus to ensure continuous improvement. He implements customer service standards to enhance customer experience and leads the compliance of service, food hygiene, health and safety standards. Resilient and resourceful, he possesses mental resilience to operate in a high pressure environment, and is capable in communicating and working effectively with co-workers and suppliers. He is expected to stand for long periods and work in a fast-paced environment.	Head Chef responsible for managing daily kitchen operations, overseeing food preparation, and developing innovative recipes and menus to improve service quality. Ensures adherence to food hygiene, health, and safety standards while providing excellent customer service. Must be resilient, resourceful, and effective in communication with team members and suppliers, capable of thriving in a high-pressure, fast-paced setting.	Junior Sous Chef tasked with assisting in the overall management of kitchen operations, focusing on food preparation and maintaining high standards of service quality. Works under the Head Chef to implement menu changes and ensure compliance with health and safety regulations. Requires strong communication skills and the ability to work efficiently in a dynamic environment, while also standing for extended periods in a busy kitchen.
  The Senior Regulations and Trade Controls Analyst/Regulations and Trade Controls Analyst assumes the responsibility of coordinating trade regulatory requirements with working level stakeholders. He/She is also responsible for reviewing organisation's compliance with regulatory requirements. He assesses adequacy, effectiveness and efficiency of compliance with regulations and make appropriate recommendations. In addition, he is expected to communicate with regional colleagues to upkeep latest the regulatory standards and guidelines for organisational compliance on both a local and regional level. He possesses good communication and coordination skills with high attention to details.	Trade Compliance Analyst responsible for coordinating regulatory requirements with stakeholders, ensuring organizational compliance, assessing the effectiveness of regulations, and communicating with regional teams to maintain up-to-date standards and guidelines.	Junior Risk Management Associate tasked with evaluating the risk factors in organizational operations, collaborating with team members to implement risk mitigation strategies, and ensuring compliance with internal policies and industry standards while maintaining detailed documentation and reports.

• Loss: MultipleNegativesRankingLoss with these parameters:
  json

  1{ 2 "scale": 20.0, 3 "similarity_fct": "cos_sim" 4}

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: steps
• per_device_train_batch_size: 16
• gradient_accumulation_steps: 2
• weight_decay: 0.1
• num_train_epochs: 10
• lr_scheduler_type: cosine
• warmup_ratio: 0.1
• fp16: True
• load_best_model_at_end: True
• batch_sampler: no_duplicates

All Hyperparameters

Training Logs

• The bold row denotes the saved checkpoint.

Framework Versions

• Python: 3.12.8
• Sentence Transformers: 5.0.0
• Transformers: 4.54.1
• PyTorch: 2.7.1+cu126
• Accelerate: 1.9.0
• Datasets: 4.0.0
• Tokenizers: 0.21.4

Citation

BibTeX

Sentence Transformers

MultipleNegativesRankingLoss