CrossEncoder based on jhu-clsp/ettin-encoder-17m

Model Details

Model Description

• Model Type: Cross Encoder
• Base model: jhu-clsp/ettin-encoder-17m
• Maximum Sequence Length: 512 tokens
• Number of Output Labels: 1 label
• Training Dataset:
  • msmarco
• Language: en

Model Sources

• Documentation: Sentence Transformers Documentation
• Documentation: Cross Encoder Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Cross Encoders on Hugging Face

Usage

Direct Usage (Sentence Transformers)

Evaluation

Metrics

Cross Encoder Reranking

• Datasets: NanoMSMARCO_R100, NanoNFCorpus_R100 and NanoNQ_R100
• Evaluated with CrossEncoderRerankingEvaluator with these parameters:
  json

  1{ 2 "at_k": 10, 3 "always_rerank_positives": true 4}

Cross Encoder Nano BEIR

• Dataset: NanoBEIR_R100_mean
• Evaluated with CrossEncoderNanoBEIREvaluator with these parameters:
  json

  1{ 2 "dataset_names": [ 3 "msmarco", 4 "nfcorpus", 5 "nq" 6 ], 7 "rerank_k": 100, 8 "at_k": 10, 9 "always_rerank_positives": true 10}

Training Details

Training Dataset

msmarco

• Dataset: msmarco at 9e329ed
• Size: 39,770,704 training samples
• Columns: query_id, positive_id, negative_id, and score
• Approximate statistics based on the first 1000 samples:

  	query_id	positive_id	negative_id	score
  type	string	string	string	float
  details	min: 11 characters mean: 33.5 characters max: 98 characters	min: 68 characters mean: 358.26 characters max: 988 characters	min: 50 characters mean: 346.46 characters max: 969 characters	min: -3.69 mean: 13.4 max: 22.15

• Samples:

  query_id	positive_id	negative_id	score
  how do you attach a sanding screen to a floor buffer	Lay the buffer on the floor so you can get underneath the housing and hook the screening brush to the central spindle. Center a sanding screen on the brush and push on it so it stays in place, then right the buffer and allow the housing to rest on the floor. Plug in the machine and grasp the handles with both hands before you turn it on.	The random orbital sander used an offset drive bearing that causes the pad to also move in an elliptical pattern. These pad movements are used in combination, randomly of course to help reduce the swirls that a non-random sheet sander might leave behind. Mechanics aside, a mojor difference is in the sanding medium. Most random orbital sanders use sanding disks, typically in a 5-inch diameter. They are attached to the sander's pad using hook & loop connections. The sanding disks have holes in them that match-up with the dust collection holes in the sander's pad.	15.936323801676433
  define method overriding	Method overriding is when a child class redefines the same method as a parent class, with the same parameters. For example, the standard Java class java.util.LinkedHashSet e…xtends java.util.HashSet. The method add() is overridden in LinkedHashSet.	In spite of its limitations, the MET concept provides a convenient method to describe the functional capacity or exercise tolerance of an individual as determined from progressive exercise testing and to define a repertoire of physical activities in which a person may participate safely, without exceeding a prescribed intensity level. PMID: 2204507	19.40437730153402
  toxic effects of constipation	by Jane Kriese. The colon is the part of the large intestine extending from the cecum to the rectum. And the most common sign of having a toxic colon is a condition called constipation. An accumulation of waste food byproducts in the colon can lead to constipation, toxic build up, weight gain and low energy.	In Summary. Commonly reported side effects of tizanidine include: bradycardia, dizziness, drowsiness, hypotension, asthenia, fatigue, and xerostomia. Other side effects include: constipation, and increased liver enzymes. See below for a comprehensive list of adverse effects.	7.669035658240318

• Loss: MarginMSELoss with these parameters:
  json

  1{ 2 "activation_fn": "torch.nn.modules.linear.Identity" 3}

Evaluation Dataset

msmarco

• Dataset: msmarco at 9e329ed
• Size: 10,000 evaluation samples
• Columns: query_id, positive_id, negative_id, and score
• Approximate statistics based on the first 1000 samples:

  	query_id	positive_id	negative_id	score
  type	string	string	string	float
  details	min: 10 characters mean: 34.37 characters max: 116 characters	min: 61 characters mean: 341.63 characters max: 952 characters	min: 73 characters mean: 346.27 characters max: 1350 characters	min: -0.85 mean: 13.13 max: 22.52

• Samples:

  query_id	positive_id	negative_id	score
  the name olmec means	The name Olmec comes from the Nahuatl word for the Olmecs: Ōlmēcatl [oːlˈmeːkat͡ɬ] (singular) or Ōlmēcah [oːlˈmeːkaʔ] (plural). This word is composed of the two words ōlli [ˈoːlːi] , meaning rubber, and mēcatl [ˈmeːkat͡ɬ] , meaning people, so the word means rubber people.hey lived in the tropical lowlands of south-central Mexico, in the present-day states of Veracruz and Tabasco. It has been speculated that Olmec derive in part from neighboring Mokaya and/or Mixe–Zoque.	Jai: Glory to, Joy, Hail. Guru; Gu - means darkness, and Ru - means a remover. So, Guru means a remover of darkness. Deva; means a shining one and is the source of the English word, Divine. So when we say Jai Guru Deva we are giving thanks to whoever we feel is the source of knowledge to us.	19.567786693572998
  what causes hissing in the ears	The following medical conditions are some of the possible causes of Hissing in ears. There are likely to be other possible causes, so ask your doctor about your symptoms. 1 Acute ear infection. Chronic ear infection.	There are many possible causes of itchy ears. Although the annoyance of itchy ears is not usually found to be serious, the condition is very real no matter the reason for the uncomfortable nuisance. Poking objects like cotton swabs, pencils, and paperclips in the ears to relieve the irritation is a dangerous and non-effective method for relief.	10.332231203715006
  multiple birth sibling definition	multiple birth(Noun) a birth in which more than one baby are born. Multiple birth. A multiple birth occurs when more than one fetus is carried to term in a single pregnancy. Different names for multiple births are used, depending on the number of offspring.	From Wikipedia, the free encyclopedia. Not to be confused with Life unworthy of life or Wrongful birth. Wrongful life is the name given to a legal action in which someone is sued by a severely disabled child (through the child's legal guardian) for failing to prevent the child's birth.1 1 Definition.rongful life is the name given to a legal action in which someone is sued by a severely disabled child (through the child's legal guardian) for failing to prevent the child's birth. Contents.	16.912671327590942

• Loss: MarginMSELoss with these parameters:
  json

  1{ 2 "activation_fn": "torch.nn.modules.linear.Identity" 3}

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: steps
• per_device_train_batch_size: 256
• per_device_eval_batch_size: 256
• learning_rate: 2e-05
• num_train_epochs: 1
• warmup_ratio: 0.1
• seed: 12
• bf16: True
• load_best_model_at_end: True

All Hyperparameters

Training Logs

Environmental Impact

• Energy Consumed: 4.348 kWh
• Carbon Emitted: 1.605 kg of CO2
• Hours Used: 1.576 hours

Training Hardware

• On Cloud: No
• GPU Model: 8 x NVIDIA H100 80GB HBM3
• CPU Model: AMD EPYC 7R13 Processor
• RAM Size: 1999.99 GB

Framework Versions

• Python: 3.10.14
• Sentence Transformers: 5.1.2
• Transformers: 4.57.1
• PyTorch: 2.9.1+cu126
• Accelerate: 1.12.0
• Datasets: 4.4.1
• Tokenizers: 0.22.1

Citation

BibTeX

Sentence Transformers

MarginMSELoss