CrossEncoder based on answerdotai/ModernBERT-base

Model Details

Model Description

• Model Type: Cross Encoder
• Base model: answerdotai/ModernBERT-base
• Maximum Sequence Length: 8192 tokens
• Number of Output Labels: 2 labels
• Training Dataset:
  • cxs-eval-dataset

Model Sources

• Documentation: Sentence Transformers Documentation
• Documentation: Cross Encoder Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Cross Encoders on Hugging Face

Usage

Direct Usage (Sentence Transformers)

Evaluation

Metrics

Cross Encoder Classification

• Dataset: validation-set
• Evaluated with CrossEncoderClassificationEvaluator

Training Details

Training Dataset

cxs-eval-dataset

• Dataset: cxs-eval-dataset at a3a8a16
• Size: 1,129 training samples
• Columns: query, result, and label
• Approximate statistics based on the first 1000 samples:

  	query	result	label
  type	string	string	int
  details	min: 193 characters mean: 661.12 characters max: 2255 characters	min: 556 characters mean: 1161.45 characters max: 1836 characters	0: ~76.70% 1: ~23.30%

• Samples:

  query	result	label
  Executive, Inflight Operation Team Lead - As an Executive, Inflight Operation Team Lead, you will excel in leading the Hi-Lift Driver team by demonstrating expertise in operational leadership while upholding high standards of safety and quality. You will contribute significantly to departmental and company objectives, ensuring strict adherence to industry regulations and operational procedures. Your role champions driving excellence in operational and engineering tasks, supporting initiatives to boost efficiency, and collaborating with cross-functional teams to achieve organizational goals, all while ensuring compliance with regulatory and organizational standards. - Air Transport	Executive (Baggage Services) - The Executive (Baggage Services) is the main point of contact for airline representatives, authorities and other departments to determine baggage handling standards and manpower requirements for baggage handling operations. He/She develops effective plans to mitigate compliance failures. He collates statistics and reports on baggage handling failures and is in charge of implementing new procedures to reduce these occurrences. He enforces a safety and security culture in the workplace and addresses internal or external audit issues. He is responsible for developing on-the-job training programmes and workplace learning plans.[object Object][object Object]A sound knowledge of airport operations, baggage handling procedures and associated administrative procedures to process requests and documentation is expected of the Executive (Baggage Services). He has good stakeholder management skills to handle internal and external stakeholders effectively. He is adept at customer service to hand...	0
  VP of Passenger Experience - Customer Experience Strategy Development: Define and implement long-term customer service strategies aligned with brand positioning, regulatory requirements, and evolving passenger expectations.[object Object][object Object]Leadership and Department Oversight: Lead cross-functional teams across reservations, in-flight services, airport staff, and support centers to ensure unified and consistent service delivery across all locations.[object Object][object Object]Performance and Quality Management: Monitor customer service KPIs (NPS, CSAT, FCR), oversee service audits, and implement improvements based on passenger feedback and competitive benchmarking. - Air Transport	Vice President - The Vice President formulates strategies for passenger services operations to ensure performance levels are aligned with evolving customer needs, technological advancements, airline brand identity and business objectives. He/She is responsible for spearheading continuous improvement and business development initiatives to improve the profitability of the business. He leads the development of Standard Operating Procedures (SOPs) and systems to mitigate safety and/or security risks and plays a pivotal role in influencing organisational development by making key decisions on human capital needs.[object Object][object Object]The Vice President for Passenger Services possesses exceptional leadership and stakeholder management skills to cultivate local and international relationships with senior stakeholders in the industry and further the business objectives of the organisation. Furthermore, he has an in-depth knowledge of the airports organisational structures, ground handling operations and safety a...	1
  Guest Services Assistant - As a Guest Services Assistant, you will uphold the highest standards of safety, security, and service in our ground operations. Your responsibilities will include verifying documentation through passport checks and ID matches, managing reservations, and issuing boarding passes. You will ensure smooth luggage tagging and inspections, oversee guest boarding and deplaning processes, and provide specialized assistance for guests with special needs, such as wheelchair services. Handling important documents like GD and crew sign-ins, as well as collecting immigration cards, is essential. You must also conduct the mandatory security questionnaire for passengers checking in luggage. Compliance with airline standards, safety protocols, and applicable laws in all operational areas is paramount. - Air Transport	Executive (Ground Services) - The Executive (Ground Services) oversees activities relating to the audit of ground service standards and develops partnerships with a wide range of audiences and stakeholders. He/She reviews service standard agreements and develops action plans to improve service efficiency for the airline. He conducts rate reviews for ground handlers regarding pricing, service quality and scope of work. In addition, he also plans cost estimates for contracts with ground handling organisations. He proposes process changes to improve passenger safety and/or security standards. He contributes to organisational development by developing on-the-job training programmes and workplace learning plans.[object Object][object Object]With foresight and highly developed analytical capabilities, the Executive (Ground Services) is able to develop action plans and provide recommendations to address any identified service delivery gaps. He develops strong rapport with the stakeholders by recognising their interests ...	0

• Loss: CrossEntropyLoss

Evaluation Dataset

cxs-eval-dataset

• Dataset: cxs-eval-dataset at a3a8a16
• Size: 141 evaluation samples
• Columns: query, result, and label
• Approximate statistics based on the first 141 samples:

  	query	result	label
  type	string	string	int
  details	min: 193 characters mean: 655.76 characters max: 2255 characters	min: 556 characters mean: 1091.27 characters max: 1810 characters	0: ~77.30% 1: ~22.70%

• Samples:

  query	result	label
  Inflight Quality Assurance Inspector - As an Inflight Quality Assurance Inspector at Santan, you are tasked with ensuring the accuracy and efficiency of meal and product handling for inflight services. Your responsibilities include verifying cart quantities, monitoring picking and staging processes, and maintaining inventory through CMS and WMS systems. You'll oversee packers and warehouse agents, manage stock adjustments and wastage reporting, and ensure compliance with FIFO and quality assurance standards. Key tasks include verifying outbound and inbound cart quantities, ensuring accurate meal picking, confirming seal and flight details in CMS, performing inventory counts, monitoring product packing, and facilitating effective communication between all parties involved. Additionally, you'll manage stock movements, update supervisors on stock issues, and ensure timely mass production by Packers or Warehouse Agents. - Air Transport	Manager (Cargo) - The Manager (Cargo) leads the development of operational strategies to improve the effectiveness of air cargo and warehouse operations. He/She is responsible for driving continuous improvement and business development initiatives to optimise processes and meet customer needs. He develops Standard Operating Procedures (SOPs) and systems to mitigate safety and/or security risks and monitors the adherence to safety and/or security standards. He also advises authorities and other teams to manage incidents involving hazardous materials and/or dangerous goods. He develops the teams technical capabilities and maintains positive morale within the teams.[object Object][object Object]The Manager (Cargo) has an extensive knowledge of cargo handling procedures, international airfreight regulations and policy requirements. He is also well-versed in organisational safety regulations and practices. He possesses strong interpersonal and stakeholder management skills in order to build and maintain stakeholder re...	0
  Manager, Pricing Systems - Manage the systems and tools that power our pricing and revenue management strategies. As Manager of Pricing Systems, you will oversee the implementation, maintenance, and enhancement of our pricing engines and related software. You'll work with IT and commercial teams to ensure system integrity, support new pricing initiatives, and troubleshoot issues. Technical expertise in airline pricing systems is a must. - Air Transport	Terminal Manager - The Terminal Manager is responsible for planning the delivery of airport services and implementing projects to improve the airport user experience. He/She collaborates with internal and external stakeholders to develop and establish compliance standards for airport operations. Besides leading research to identify new service offerings for the airport, he also enforces safety and/or security standards for the organisation. He sources for contractors to perform airport operations and establishes key indicators to track their performances. He also develops on-the-job training programmes for the department.[object Object][object Object]The Terminal Manager possesses a sound knowledge of airport and airside operations, Standard Operating Procedures (SOPs) and airport security and emergency response plans. He travels across the terminals to review operational processes and resolve incidents at the airport. To ensure operational plans and projects are implemented efficiently and effectively, he displa...	0
  Executive, Inflight Operation Team Lead - As an Executive, Inflight Operation Team Lead, you will excel in leading the Hi-Lift Driver team by demonstrating expertise in operational leadership while upholding high standards of safety and quality. You will contribute significantly to departmental and company objectives, ensuring strict adherence to industry regulations and operational procedures. Your role champions driving excellence in operational and engineering tasks, supporting initiatives to boost efficiency, and collaborating with cross-functional teams to achieve organizational goals, all while ensuring compliance with regulatory and organizational standards. - Air Transport	Executive (Ramp / Technical Ramp) - The Executive (Ramp/Technical Ramp) performs regular audits to ensure that ramp/technical ramp operations comply with Standard Operating Procedures (SOPs). He/She recommends enhancements to address areas of non-compliance, improves operational efficiencies and develops action plans to prevent safety and/or security issues from recurring. He also develops workplace learning plans and on-the-job training programmes to enhance the capabilities of teams.[object Object] [object Object]The Executive (Ramp/Technical Ramp) has a sound knowledge of airport operations and ramp/technical ramp procedures. He also has strong analytical abilities to identify root causes of ground handling related delays and their potential implications. He is results-oriented and possesses excellent communication and interpersonal skills. Furthermore, he has strong computer literacy skills and competence in learning orientation to determine learning and developmental needs of his team members.	0

• Loss: CrossEntropyLoss

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: epoch
• per_device_train_batch_size: 16
• per_device_eval_batch_size: 32
• learning_rate: 4e-05
• weight_decay: 0.01
• num_train_epochs: 10
• warmup_ratio: 0.1
• bf16: True
• load_best_model_at_end: True

All Hyperparameters

Click to expand

• overwrite_output_dir: False
• do_predict: False
• eval_strategy: epoch
• prediction_loss_only: True
• per_device_train_batch_size: 16
• per_device_eval_batch_size: 32
• per_gpu_train_batch_size: None
• per_gpu_eval_batch_size: None
• gradient_accumulation_steps: 1
• eval_accumulation_steps: None
• torch_empty_cache_steps: None
• learning_rate: 4e-05
• weight_decay: 0.01
• adam_beta1: 0.9
• adam_beta2: 0.999
• adam_epsilon: 1e-08
• max_grad_norm: 1.0
• num_train_epochs: 10
• max_steps: -1
• lr_scheduler_type: linear
• lr_scheduler_kwargs: {}
• warmup_ratio: 0.1
• warmup_steps: 0
• log_level: passive
• log_level_replica: warning
• log_on_each_node: True
• logging_nan_inf_filter: True
• save_safetensors: True
• save_on_each_node: False
• save_only_model: False
• restore_callback_states_from_checkpoint: False
• no_cuda: False
• use_cpu: False
• use_mps_device: False
• seed: 42
• data_seed: None
• jit_mode_eval: False
• use_ipex: False
• bf16: True
• fp16: False
• fp16_opt_level: O1
• half_precision_backend: auto
• bf16_full_eval: False
• fp16_full_eval: False
• tf32: None
• local_rank: 0
• ddp_backend: None
• tpu_num_cores: None
• tpu_metrics_debug: False
• debug: []
• dataloader_drop_last: False
• dataloader_num_workers: 0
• dataloader_prefetch_factor: None
• past_index: -1
• disable_tqdm: False
• remove_unused_columns: True
• label_names: None
• load_best_model_at_end: True
• ignore_data_skip: False
• fsdp: []
• fsdp_min_num_params: 0
• fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
• fsdp_transformer_layer_cls_to_wrap: None
• accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
• deepspeed: None
• label_smoothing_factor: 0.0
• optim: adamw_torch
• optim_args: None
• adafactor: False
• group_by_length: False
• length_column_name: length
• ddp_find_unused_parameters: None
• ddp_bucket_cap_mb: None
• ddp_broadcast_buffers: False
• dataloader_pin_memory: True
• dataloader_persistent_workers: False
• skip_memory_metrics: True
• use_legacy_prediction_loop: False
• push_to_hub: False
• resume_from_checkpoint: None
• hub_model_id: None
• hub_strategy: every_save
• hub_private_repo: None
• hub_always_push: False
• hub_revision: None
• gradient_checkpointing: False
• gradient_checkpointing_kwargs: None
• include_inputs_for_metrics: False
• include_for_metrics: []
• eval_do_concat_batches: True
• fp16_backend: auto
• push_to_hub_model_id: None
• push_to_hub_organization: None
• mp_parameters:
• auto_find_batch_size: False
• full_determinism: False
• torchdynamo: None
• ray_scope: last
• ddp_timeout: 1800
• torch_compile: False
• torch_compile_backend: None
• torch_compile_mode: None
• include_tokens_per_second: False
• include_num_input_tokens_seen: False
• neftune_noise_alpha: None
• optim_target_modules: None
• batch_eval_metrics: False
• eval_on_start: False
• use_liger_kernel: False
• liger_kernel_config: None
• eval_use_gather_object: False
• average_tokens_across_devices: False
• prompts: None
• batch_sampler: batch_sampler
• multi_dataset_batch_sampler: proportional

Training Logs

• The bold row denotes the saved checkpoint.

Framework Versions

• Python: 3.12.11
• Sentence Transformers: 4.1.0
• Transformers: 4.53.0
• PyTorch: 2.7.1+cu126
• Accelerate: 1.8.1
• Datasets: 3.6.0
• Tokenizers: 0.21.2

Citation

BibTeX

Sentence Transformers