SentenceTransformer based on nomic-ai/modernbert-embed-base

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: nomic-ai/modernbert-embed-base
• Maximum Sequence Length: 8192 tokens
• Output Dimensionality: 768 dimensions
• Similarity Function: Cosine Similarity
• Training Dataset:
  • touch-rugby-modernbert-pairs

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 8192, 'do_lower_case': False}) with Transformer model: ModernBertModel 
  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

Training Details

Training Dataset

touch-rugby-modernbert-pairs

• Dataset: touch-rugby-modernbert-pairs at 7cb0ae2
• Size: 305 training samples
• Columns: question and related_chunk
• Approximate statistics based on the first 305 samples:

  	question	related_chunk
  type	string	string
  details	min: 10 tokens mean: 18.73 tokens max: 36 tokens	min: 147 tokens mean: 231.2 tokens max: 319 tokens

• Samples:

  question	related_chunk
  What is defined as 'Forward' in the context of Touch Rugby?	Referee[object Object]The match official(s) appointed to make Rulings during the conduct [object Object]of a match.Rollball[object Object]The act of bringing the ball into play following a Touch or a Change [object Object]of Possession.Ruck/Rollball Area[object Object]The area, not exceeding one (1) metre in distance, between the [object Object]player performing a Rollball and the Half.Ruling[object Object]The decision made by a Referee as a result of particular [object Object]circumstance and may result in a Play On, a Tap Penalty, a discipline [object Object]option, Change of Possession or a Try.Seven Metre Zone[object Object]The area between the seven (7) metre line and the Try Line.See [object Object]Appendix 1.Sidelines[object Object]The side boundaries of the Field of Play.See Appendix 1.Sin Bin[object Object]A player sent to the Sin-Bin Area for a period of four (4) completed [object Object]Possessions.The player is counted as a player on the Field of Play [object Object]and cannot be replaced or Interchanged.
  What is the numerical difference between the teams on the field of play during a Drop-Off if a player has been sent to the sin bin?	24.5 For the avoidance of doubt for clauses 24.3 and 24.4 the non-offending Team [object Object]will retain a numerical advantage on the Field of Play during the Drop-Off.25  Match Officials [object Object]25.1 The Referee is the sole judge on all match related matters inside the Perimeter [object Object]for the Duration of a match, has jurisdiction over all players, coaches and [object Object]officials and is required to:[object Object]25.1.1 Inspect the Field of Play, Line Markings and Markers prior to the [object Object]commencement of the Match to ensure the safety of all participants.25.1.2 Adjudicate on the Rules of the game;[object Object]25.1.3 Impose any sanction necessary to control the match;[object Object]25.1.4 Award Tries and record the progressive score;[object Object]25.1.5 Maintain a count of Touches during each Possession;[object Object]25.1.6 Award Penalties for Infringements against the Rules; and[object Object]25.1.7 Report to the relevant competition administration any Sin Bins, [object Object]Dismissals or injuries to any participant sustained during a Match.
  What happens if neither team is leading after two minutes of play in a Drop-Off?	24.1.5 Should neither Team be leading at the expiration of two (2) minutes, a [object Object]signal is given and the match will pause at the next Touch or Dead Ball.Each Team will then remove another player from the Field of Play.24.1.6 The Match will recommence immediately after the players have left the [object Object]field at the same place where it paused (i.e.the Team retains Possession [object Object]at the designated number of Touches, or at Change of Possession due to [object Object]some Infringement or the sixth Touch) and the Match will continue until a [object Object]Try is scored.24.1.7 There is no time off during the Drop-Off and the clock does not stop at [object Object]the two (2) minute interval.24.1.8 Substitution during the Drop-Off is permitted in accordance with normal [object Object]Interchange Rules.24.2 Mixed gender Teams may have no more than (2) males on the field during the [object Object]Drop-Off.

• Loss: MultipleNegativesRankingLoss with these parameters:
  json

  1{ 2 "scale": 20.0, 3 "similarity_fct": "cos_sim" 4}

Evaluation Dataset

touch-rugby-modernbert-pairs

• Dataset: touch-rugby-modernbert-pairs at 7cb0ae2
• Size: 305 evaluation samples
• Columns: question and related_chunk
• Approximate statistics based on the first 305 samples:

  	question	related_chunk
  type	string	string
  details	min: 13 tokens mean: 17.61 tokens max: 32 tokens	min: 147 tokens mean: 230.39 tokens max: 319 tokens

• Samples:

  question	related_chunk
  What is the penalty for an attacking player obstructing a defender in Touch Rugby?	Ruling = A Penalty to the Attacking Team at the point of the Infringement or on the seven (7) [object Object]metre line directly Forward of the Infringement.15.4 When a Rollball occurs within Defending Team’s Seven Metre Zone or a Penalty [object Object]Tap within ten (10) metres of the Defending Team’s Try Line, all players from the [object Object]Defending Team must have both feet on or behind their Try Line and no other [object Object]part of the body in contact with the ground Forward of their Try Line.Ruling = A Penalty to the Attacking Team at the seven (7) metre line directly Forward of the [object Object]point of the Infringement.15.5 After effecting the Touch, the defending player must retire the required seven [object Object](7) metres or to the Defending Try Line as indicated by the Referee without [object Object]interfering with the Attacking Team.Ruling = A Penalty to the Attacking Team ten (10) metres Forward of the Infringement or if [object Object]on the Defensive Try Line, on the seven (7) metre line.
  When must a player perform a Rollball seven metres in-field?	13.5 A player may only perform a Rollball at the Mark under the following [object Object]circumstances:[object Object]13.5.1 when a Touch has been made; or[object Object]13.5.2 when Possession changes following the sixth Touch; or[object Object]13.5.3 when Possession changes due to the ball being dropped or passed and [object Object]goes to the ground; or[object Object]13.5.4 when Possession changes due to an Infringement by an attacking player [object Object]at a Penalty, a Tap or a Rollball; or[object Object]FIT Playing Rules - 5th Edition[object Object]COPYRIGHT © Touch Football Australia 2020[object Object]11[object Object]13.5.5 when Possession changes after the Half is Touched or when the Half [object Object]places the ball on or over the Try Line; or[object Object]13.5.6 in replacement of a Penalty Tap; or[object Object]13.5.7 when so directed by the Referee.13.6 A player is to perform a Rollball seven (7) metres in-field under the following [object Object]circumstances:[object Object]13.6.1 when a Change of Possession takes place due to a player in Possession [object Object]making contact with the Sideline or any ground outside the Field of Play, [object Object]prior to a Touch being made; or[object Object]13.6.2 when the ball not in Poss...
  What is the ruling if a player uses excessive force when making a touch?	FIT Playing Rules - 5th Edition[object Object]8[object Object]COPYRIGHT © Touch Football Australia 2020[object Object]9.6 If a player mishandles the ball and even if in an effort to gain control, the ball [object Object]is accidentally knocked Forward into any other Player, a Change of Possession [object Object]results.10  The Touch [object Object]10.1 A Touch may be made by either a defending player or a player in Possession.10.2 A defending player may not claim a Touch if contact has not been made.If a [object Object]player claims a Touch has been made, but the Referee is unsure the Touch will [object Object]count.Ruling = A Penalty to the Attacking Team at the point of the Infringement and the offending [object Object]player sent to the Sin Bin.10.3 Players of both Defending and Attacking Teams are to use the minimum force [object Object]necessary to make a Touch.Players must ensure that the method employed in [object Object]making a Touch does not pose an unnecessary risk to player safety.Ruling = A Penalty to the non-offending Team at the point of the Infringement.

• Loss: MultipleNegativesRankingLoss with these parameters:
  json

  1{ 2 "scale": 20.0, 3 "similarity_fct": "cos_sim" 4}

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: steps
• per_device_train_batch_size: 32
• per_device_eval_batch_size: 32
• learning_rate: 2e-05
• num_train_epochs: 1
• lr_scheduler_type: cosine
• warmup_ratio: 0.3

All Hyperparameters

Training Logs

Framework Versions

• Python: 3.12.4
• Sentence Transformers: 3.3.1
• Transformers: 4.48.0
• PyTorch: 2.5.1
• Accelerate: 1.3.0
• Datasets: 2.17.1
• Tokenizers: 0.21.0

Citation

BibTeX

Sentence Transformers

MultipleNegativesRankingLoss