SentenceTransformer based on google/embeddinggemma-300m

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: google/embeddinggemma-300m
• Maximum Sequence Length: 2048 tokens
• Output Dimensionality: 768 dimensions
• Similarity Function: Cosine Similarity

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 2048, 'do_lower_case': False, 'architecture': 'Gemma3TextModel'})
  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Dense({'in_features': 768, 'out_features': 3072, 'bias': False, 'activation_function': 'torch.nn.modules.linear.Identity'})
  (3): Dense({'in_features': 3072, 'out_features': 768, 'bias': False, 'activation_function': 'torch.nn.modules.linear.Identity'})
  (4): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

Training Details

Training Dataset

Unnamed Dataset

• Size: 3,200 training samples
• Columns: anchor, positive, and negative
• Approximate statistics based on the first 1000 samples:

  	anchor	positive	negative
  type	string	string	string
  details	min: 6 tokens mean: 12.38 tokens max: 31 tokens	min: 77 tokens mean: 131.04 tokens max: 221 tokens	min: 79 tokens mean: 130.16 tokens max: 220 tokens

• Samples:

  anchor	positive	negative
  what two categories are the four stages of sleep broken up into?	both measures can provide insight into how well a person is sleeping, as a longer sleep latency can lead to a lower sleep efficiency. however, having a high sleep latency, or taking a long time to fall asleep, is not the only factor that impacts sleep efficiency. a person can also have a low sleep efficiency due to waking up throughout the night or early in the morning. each night, a person cycles through multiple stages of sleep. these four stages are broken up into two categories: rapid eye movement (rem) and non-rapid eye movement (nrem) sleep.	bipap machines are also sometimes prescribed to people who have sleep apnea as well as severe obesity or certain other health conditions, like chronic obstructive pulmonary disease and hypoventilation. automatic positive airway pressure machines, often called apap or auto-cpap machines, also work similarly to cpap machines in that they connect to a sleeper's face using a tube and mask, then push out air to keep the airway open. apap machines differ from cpap machines with their ability to automatically adjust the pressure of air they release. this ability can make the machine more comfortable than a cpap, since sleepers need different levels of pressure at different times of night, depending on their sleeping position, sleep stage, or amount of congestion.
  what do internal nasal dilators work better than?	internal nasal dilators may work better than nasal strips. also known as myofunctional therapy, certain mouth exercises are designed to improve the function of the mouth and upper respiratory tract to reduce snoring. for example, these movements may include pronouncing vowel sounds, swallowing and chewing motions, and moving the tongue against the teeth to strengthen the surrounding muscles. you can learn how to perform these exercises on your own using videos and apps. however, it is unclear if self-directed mouth exercises are as effective as those performed under the direction of a healthcare provider such as a speech therapist.	people with narcolepsy face an increased risk of cardiovascular and metabolic conditions such as high blood pressure, high cholesterol, obesity, and diabetes. one reason for the increased prevalence of these conditions in people with narcolepsy may be the multiple roles orexins play in the body. in addition to causing issues in maintaining sleep-wake cycles, a loss of orexin-producing neurons can also affect physical activity and weight gain, nighttime blood pressure, and the buildup of plaque in the arteries - all potential causes of heart disease. narcolepsy is also associated with psychiatric disorders, including attention deficit hyperactivity disorder (adhd), anxiety, eating disorders, depression, and schizophrenia. researchers hypothesize that lifestyle changes and impairment caused by the symptoms of narcolepsy may lead to the development of psychiatric disorders, or that both narcolepsy and psychiatric disorders share similar causes. while the impact of narcolepsy on mental hea...
  how many americans struggle with chronic sleep and wakefulness disorders?	between 50 and 70 million american adults struggle with chronic sleep and wakefulness disorders. dyssomnia refers to the collection of sleep disorders that negatively impact the quantity and quality of sleep. with dyssomnia, you might struggle to fall asleep at night, which is a symptom of insomnia, or feel the need to sleep excessively, which is called hypersomnolence. additionally, common symptoms of dyssomnia include excessive daytime sleepiness or feeling unrested when you wake up in the morning. more specific symptoms vary depending on the type of sleep disorder you are experiencing. unlike parasomnias, dyssomnias generally do not involve irregular physical actions while asleep.	sleep talking that is offensive, sexually explicit, or reveals secrets may cause embarrassment or shame; however, people are very rarely aware that they are talking in their sleep at the time and typically have no recollection of the episodes when they wake up. episodes of sleep talking tend to be short, and they rarely involve long or drawn-out conversations. the total episode may involve only a handful of words or a few sentences. research is mixed about the source of the content during episodes of sleep talking. speech may not have any clear connection to a person's life, recent events, or prior conversations.

• Loss: MultipleNegativesRankingLoss with these parameters:
  json

  1{ 2 "scale": 20.0, 3 "similarity_fct": "cos_sim", 4 "gather_across_devices": false 5}

Evaluation Dataset

Unnamed Dataset

• Size: 800 evaluation samples
• Columns: anchor, positive, and negative
• Approximate statistics based on the first 800 samples:

  	anchor	positive	negative
  type	string	string	string
  details	min: 6 tokens mean: 12.7 tokens max: 30 tokens	min: 79 tokens mean: 130.2 tokens max: 238 tokens	min: 79 tokens mean: 130.1 tokens max: 217 tokens

• Samples:

  anchor	positive	negative
  what do people with kls experience?	kleine-levin syndrome (kls) is a type of recurrent hypersomnia. people with kls experience episodes of excessive sleeping that last between a few days and a few weeks. they may need to sleep as many as 20 hours a day. these episodes of needing extra sleep can occur multiple times in a year but eventually subside over time. the disorder affects one to two people per million and primarily adolescent boys. around 70% of people with kls are male. kls shares characteristics similar to narcolepsy and can cause excessive sleepiness and hunger. the onset of kls is sudden and may at first present like the flu.	as bedtime approaches at the end of the day, our ability to regulate our behavior is already at its lowest. sleep-deprived people may have even less ability to exert self-control and adhere to their intended bedtimes. to add to this, people who procrastinate in other areas of life, such as school or work, are more likely to procrastinate at bedtime. another theory is that bedtime procrastination is related to chronotypes. chronotype is the biological inclination to sleep at a certain time of the day, such as being a night owl versus an early bird. evening types, or night owls, are more likely to procrastinate at bedtime during the week than other chronotypes.
  why are queen size mattresses slightly more expensive than full size models?	a full mattress - also known as a double - measures 54 inches wide by 75 inches long, whereas a queen measures 60 inches wide by 80 inches long. a full size mattress is the same length as a twin mattress, while the length of a queen is comparable to a twin xl or a king mattress. in terms of width, a full is just wide enough to accommodate two sleepers, though most partners tend to prefer a queen. because of their larger size, queen size mattresses are slightly more expensive than full size models. while both queen and full sizes cost more than twin mattresses, they have lower price-points than king sizes.	continuous positive airway pressure (cpap) therapy might be the gold standard for treating obstructive sleep apnea (osa). but a recent study out of la fe university and polytechnic hospital in spain says cpap treatment may not be as effective for patients ages 80 years and older. for this age range, the study looked at how cpap therapy affects sleep apnea symptoms and other factors, including brain function. researchers found that cpap therapy decreased patients' snoring and witnessed apneas, which is when a patient gasps for air and wakes from sleep. they also found that cpap therapy did not improve the patients' other sleep-related symptoms, such as frequent nighttime awakenings to use the bathroom, choking, or nightmares.
  how does the liver convert tryptophan into vitamin b3?	with the help of iron, riboflavin, and vitamin b6, the liver converts tryptophan into vitamin b3, also known as niacin. niacin plays a role in metabolizing energy and creating dna. tryptophan is also needed to produce serotonin, a neurotransmitter involved in sleep, appetite, pain, and mood. serotonin then works with enzymes to create melatonin, a hormone that regulates your sleep-wake cycle by making you feel tired at bedtime. this progression that begins with tryptophan consumption and ends with melatonin production is crucial for healthy sleep. there are two types of tryptophan, l-tryptophan and d-tryptophan. both serve the same general functions but differ slightly at the molecular level.	most knee pillows are smaller than regular pillows and are designed with a thinner center and flared ends. the middle section can be tucked under the knees when back sleeping or between the knees when side sleeping, while the flared ends help the pillow stay in place. because the middle is thinner than most regular pillows, knee pillows provide just the right amount of support for spinal alignment without overextending the knees. several types of pillows feature special designs to support the natural curvature of the neck. cervical pillows are higher under the neck and lower under the head area. u-shaped travel pillows adapt this concept for upright sleeping, with an open space for the head and a wraparound design that helps support the neck. pregnancy pillows come in many styles, but they typically feature some variation of a large u-shape or c-shape. they are designed to wrap around the body and support a baby bump to take pressure off the back and hips when you're lying on your side...

• Loss: MultipleNegativesRankingLoss with these parameters:
  json

  1{ 2 "scale": 20.0, 3 "similarity_fct": "cos_sim", 4 "gather_across_devices": false 5}

Training Hyperparameters

Non-Default Hyperparameters

• per_device_train_batch_size: 32
• learning_rate: 2e-05
• num_train_epochs: 10
• warmup_ratio: 0.1

All Hyperparameters

Framework Versions

• Python: 3.12.11
• Sentence Transformers: 5.1.2
• Transformers: 4.57.1
• PyTorch: 2.8.0+cu128
• Accelerate: 1.12.0
• Datasets: 4.4.1
• Tokenizers: 0.22.1

Citation

BibTeX

Sentence Transformers

MultipleNegativesRankingLoss