SentenceTransformer based on nomic-ai/modernbert-embed-base

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: nomic-ai/modernbert-embed-base
• Maximum Sequence Length: 8192 tokens
• Output Dimensionality: 768 dimensions
• Similarity Function: Cosine Similarity
• Training Dataset:
  • ssf-train-valid-v4.1

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 8192, 'do_lower_case': False, 'architecture': 'ModernBertModel'})
  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

Training Details

Training Dataset

ssf-train-valid-v4.1

• Dataset: ssf-train-valid-v4.1 at b41efb0
• Size: 6,032 training samples
• Columns: anchor, positive, and negative
• Approximate statistics based on the first 1000 samples:

  	anchor	positive	negative
  type	string	string	string
  details	min: 57 tokens mean: 169.25 tokens max: 403 tokens	min: 55 tokens mean: 138.16 tokens max: 267 tokens	min: 46 tokens mean: 108.1 tokens max: 205 tokens

• Samples:

  anchor	positive	negative
  The Business Development Manager is responsible for managing business development strategy implementation. He/she implements market expansion and new market plans for business growth. By engaging key internal stakeholders, he supports cross-functional collaboration for business development activities. He also performs data analysis on partnerships, Joint Ventures (JV) and Mergers and Acquisitions (M&A) to expand the market share of the organisation. Independent and insightful, he possesses strong business acumen and is able to source for growth opportunities. He supports the proactive pursuit of growth opportunities by being aware of market trends, industry events, competitors' actions and clients' needs. He is also able to adapt strategies and plans to ensure success in a competitive and global market. He travels frequently, maintains rapport with potential and existing clients, and networks extensively outside of the office to develop business relationships.	The Business Development Manager leads the execution of strategies aimed at driving business expansion and entering new markets. Collaborating closely with key internal teams, this role fosters cross-departmental initiatives to support growth objectives. The manager conducts detailed analyses of partnerships, joint ventures, and mergers and acquisitions to enhance the company’s market presence. Demonstrating strong commercial insight and independent judgment, the incumbent identifies and capitalizes on new business opportunities. By staying informed of industry trends, competitor activities, and client requirements, the manager continuously refines strategies to maintain competitive advantage in a global marketplace. This position involves regular travel and active networking to build and sustain relationships with both prospective and current clients.	The Business Development Manager oversees the recruitment and onboarding processes within the human resources function of the company. He/she coordinates talent acquisition campaigns, manages employee relations, and ensures compliance with employment laws. The manager collaborates with department heads to assess staffing needs and develops training programs to enhance workforce capabilities. Responsible for maintaining HR records and administering benefits, the role requires strong interpersonal and organizational skills. Unlike a market-facing role, this position focuses primarily on internal employee management and does not involve external client engagement or market expansion activities.
  The Head of Product defines the organisations product development vision and strategy, and ensures alignment of the product roadmap with the strategy and vision. He/She anticipates the impacts of internal and external business challenges and market conditions on the organisation's product development roadmap. He oversees the organisations product development process, and enhancements to product portfolios to improve their commercial performance. He guides development teams on issues related to the product design, development and deployment for the product portfolio, and development of differentiated strategies across the lines of business. He distils insights and competitive intelligence with various market analyses to grow the organisations business. He works with various teams across the organisation. He is knowledgeable of product development and management practices and tools, as well as product branding and pricing methodologies. He is also knowledgeable of new and emerging consum...	The Head of Product leads the company’s product vision and strategic direction, ensuring that the product roadmap aligns closely with overarching business objectives. This role involves anticipating how internal dynamics and market trends may affect product development plans. The Head of Product manages the full product lifecycle, driving enhancements that boost portfolio profitability and competitive positioning. They provide guidance to cross-functional teams on product design, development, and launch, fostering innovative strategies tailored to different business units. By synthesizing market intelligence and competitive analysis, they identify growth opportunities and shape the company’s product strategy. Collaborating extensively across departments, the Head of Product leverages expertise in product management methodologies, branding, and pricing strategies. They stay abreast of emerging consumer behaviors and industry trends, adopting a global perspective to shape a visionary pro...	The Head of Product manages the company’s internal communications and public relations strategy, ensuring all messaging aligns with the corporate brand and reputation goals. They monitor both internal and external communication channels to anticipate potential challenges and opportunities impacting the organization’s image. The Head of Product oversees the development of corporate messaging frameworks and media relations initiatives, guiding teams on content creation, media engagement, and crisis communication strategies. They analyze public sentiment and competitive communication tactics to enhance the company’s visibility. Working closely with marketing, legal, and executive teams, the Head of Product applies expertise in communication technologies and branding consistency. They stay informed about emerging communication trends and digital platforms, integrating global best practices to craft compelling narratives. As a persuasive and charismatic leader, they inspire communication te...
  The Production Manager oversees all operations of the food production plant, with a focus on simplifying work processes, reducing costs and increasing production process efficiency. He/She is responsible for setting key performance indicators (KPI) for the production plant, and formulating new food production standards and standard operating procedures (SOPs). The Production Manager monitors quality assurance on an overall level, investigates production and/or quality issues and recommends solutions. He is required to go through training in internal food safety audits and serves on the organisation's food safety internal audit committee. He operates in a food production environment and may be required to work shifts. He should be comfortable with exposure to physically demanding work conditions (i.e. long standing hours, hot or cold temperatures).	The Production Manager is responsible for managing the entire food manufacturing facility, focusing on optimizing workflows, cutting operational costs, and enhancing production efficiency. This role involves establishing key performance metrics for the plant, developing updated standards and standard operating procedures for food production, and overseeing overall quality assurance. The Production Manager addresses production and quality concerns through thorough investigation and proposes effective corrective actions. Participation in internal food safety audit training and membership on the company’s food safety audit committee are essential. The role requires working in a food processing environment, which may include shift work and handling physically demanding conditions such as prolonged standing and exposure to varying temperatures.	The Production Supervisor directs daily operations within a pharmaceutical packaging facility, prioritizing compliance with drug safety regulations and maintaining equipment calibration. This position involves setting production targets, enforcing cleanroom protocols, and overseeing product labeling accuracy. The Production Supervisor conducts routine equipment inspections and coordinates with quality control teams to resolve packaging discrepancies. Training in pharmaceutical Good Manufacturing Practices (GMP) and participation in regulatory audit preparations are required. The role demands working in a controlled, sterile environment with adherence to strict hygiene standards and occasional shift work.

• Loss: MultipleNegativesRankingLoss with these parameters:
  json

  1{ 2 "scale": 20.0, 3 "similarity_fct": "cos_sim", 4 "gather_across_devices": false 5}

Evaluation Dataset

ssf-train-valid-v4.1

• Dataset: ssf-train-valid-v4.1 at b41efb0
• Size: 1,508 evaluation samples
• Columns: anchor, positive, and negative
• Approximate statistics based on the first 1000 samples:

  	anchor	positive	negative
  type	string	string	string
  details	min: 57 tokens mean: 170.2 tokens max: 403 tokens	min: 56 tokens mean: 138.34 tokens max: 266 tokens	min: 51 tokens mean: 108.37 tokens max: 236 tokens

• Samples:

  anchor	positive	negative
  The Capacity Manager oversee daily operations and review capacity forecasts and develops process improvements to maximise voyage yields. He/She develops cargo mixture strategies, based on profit maximisation and customer demand, and manages all vessel operations planning to optimise capacity utilisation, terminal operations, vessel utilisation, vessel movement and route adjustment strategies. He has a strong understanding of commercial and financial drivers in the shipping industry. He has strong leadership skills to manage multiple internal and external stakeholders and demonstrates commitment to exceptional customer service.	The Capacity Manager is responsible for managing daily operational activities and evaluating capacity projections to enhance voyage profitability. This role involves formulating cargo allocation plans aimed at maximizing profits and meeting customer needs, alongside coordinating vessel operation schedules to improve capacity use, terminal efficiency, vessel deployment, navigation, and routing strategies. The Capacity Manager possesses deep commercial and financial insight within the maritime sector and exhibits strong leadership abilities to coordinate diverse stakeholder groups while maintaining a high standard of customer service excellence.	The Capacity Planner coordinates warehouse inventory levels and supervises stock replenishment to meet retail demand forecasts. They focus on optimizing storage space usage, managing supplier schedules, and streamlining logistics processes for efficient product flow. The role requires proficiency in supply chain software and collaboration with procurement and distribution teams but does not involve vessel operations or maritime commercial analysis. Strong organizational skills and attention to detail are essential for ensuring timely delivery and inventory accuracy.
  The Research Analyst is responsible for conducting research based on requirements and requests from various internal business units. He/She also facilitates investment processes by providing assumptions necessary for forecasting and investment recommendations based on the research conducted. The Research Analyst is self-motivated, driven and passionate about learning. He takes the initiative to share research outcomes that are useful to other business units. The role also requires him to be able to analyse and interpret information quickly and to condense and bring across complex research ideas and concepts in easily understandable terms.	The Research Analyst supports multiple internal departments by performing targeted research aligned with their specific needs. This role involves contributing to investment decision-making by supplying key assumptions that inform forecasting and asset allocation suggestions. The Research Analyst must be proactive, eager to expand their knowledge, and willing to disseminate valuable insights across teams. Strong analytical skills are essential for swiftly interpreting data and simplifying intricate research findings into clear, accessible language.	The Business Development Analyst focuses on identifying new market opportunities and building client relationships to drive revenue growth across various sectors. This role requires expertise in sales strategies, negotiation, and customer engagement rather than conducting in-depth research or investment analysis. The Business Development Analyst must be persuasive, target-driven, and skilled at presenting compelling business proposals to potential partners and stakeholders.
  The Head of Chartering manages the chartering function and oversees a ship chartering team in the execution of the organisation's chartering business. He/She negotiates and/or evaluates potential business development opportunities and is able to synthesise complex concepts and information to distil them into actionable propositions. He is a self-motivated individual who works independently to lead a team and support their efforts in accomplishing goals, and provides guidance where necessary.	The Head of Chartering leads the ship chartering department, supervising a team responsible for executing the company’s chartering operations. This role involves assessing and negotiating new business ventures, translating intricate market data and insights into strategic actions. The individual is a proactive leader who independently drives team performance, offers direction to ensure objectives are met, and fosters a collaborative environment to achieve business targets.	The Head of Operations directs the vessel maintenance division, coordinating technical teams to ensure fleet readiness and compliance with maritime safety standards. This role focuses on overseeing repair schedules, managing maintenance budgets, and liaising with regulatory bodies to uphold operational excellence. The individual works closely with engineering staff to optimize vessel uptime and supports continuous improvement initiatives across the maintenance function.

• Loss: MultipleNegativesRankingLoss with these parameters:
  json

  1{ 2 "scale": 20.0, 3 "similarity_fct": "cos_sim", 4 "gather_across_devices": false 5}

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: epoch
• per_device_train_batch_size: 16
• per_device_eval_batch_size: 32
• gradient_accumulation_steps: 32
• learning_rate: 2e-05
• weight_decay: 0.01
• num_train_epochs: 5
• lr_scheduler_type: cosine
• warmup_ratio: 0.1
• bf16: True
• tf32: True
• load_best_model_at_end: True
• gradient_checkpointing: True
• batch_sampler: no_duplicates

All Hyperparameters

Training Logs

• The bold row denotes the saved checkpoint.

Framework Versions

• Python: 3.12.8
• Sentence Transformers: 5.1.0
• Transformers: 4.55.0
• PyTorch: 2.8.0+cu128
• Accelerate: 1.10.0
• Datasets: 4.0.0
• Tokenizers: 0.21.4

Citation

BibTeX

Sentence Transformers

MultipleNegativesRankingLoss