SentenceTransformer based on flax-sentence-embeddings/all_datasets_v4_MiniLM-L6

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: flax-sentence-embeddings/all_datasets_v4_MiniLM-L6
• Maximum Sequence Length: 128 tokens
• Output Dimensionality: 384 tokens
• Similarity Function: Cosine Similarity
• Training Dataset:
  • json

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 128, 'do_lower_case': False}) with Transformer model: BertModel 
  (1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

Evaluation

Metrics

Information Retrieval

• Dataset: dim_384
• Evaluated with InformationRetrievalEvaluator

Training Details

Training Dataset

json

• Dataset: json
• Size: 1,814 training samples
• Columns: positive and anchor
• Approximate statistics based on the first 1000 samples:

  	positive	anchor
  type	string	string
  details	min: 3 tokens mean: 118.96 tokens max: 128 tokens	min: 14 tokens mean: 34.93 tokens max: 116 tokens

• Samples:

  positive	anchor
  [object Object][object Object]Epilepsy is a neurological disorder characterized by recurrent seizures, which can be sudden, abnormal electrical events in the brain. Seizures can affect different parts of the brain and range from mild to severe. Symptoms can include muscle stiffness, twitching, loss of consciousness, and cognitive disruptions. Seizures can be divided into focal (partial) seizures and generalized seizures.[object Object][object Object]### Causes:[object Object]1. [object Object]: These can lead to scar tissue and abnormal electrical activity.[object Object]2. [object Object]: Genetic or developmental issues can cause seizures.[object Object]3. [object Object]: These can result in seizures.[object Object]4. [object Object]: Some genetic conditions lead to epilepsy.[object Object][object Object]### Complications:[object Object]- [object Object]: Continuous seizure activity lasting more than five minutes.[object Object]- [object Object]: Unexplained death during an untreated condition, especially if seizures aren't controlled.[object Object]- [object Object]: Increased risk for depression, anxiety, and	Search for medical conditions not treatable by any known medications that present with hoarseness as a symptom.
  [object Object]Diphyllobothriasis, also known as bothriocephalosis, is a parasitosis caused by the intestinal infection with the larval stage of the tapeworm Diphyllobothrium. This condition is characterized by a broad array of symptoms, including frequent stomach discomfort, nausea, appetite loss, fatigue, and weakness. These symptoms are medically attributed to anemia, which stems from vitamin B12 deficiency—a common complication linked to this parasitosis. The anemia caused by diphyllobothriasis can also resemble Biermer's anemia, distinguished by abnormally large red blood cells. Individuals with a family history of ceestode infections, such as diphyllobothriasis, and those who exhibit symptoms such as those described, may be more susceptible to this condition. The disease, which is cosmopolitan in nature, has been reported in Europe, primarily in areas like the Italian, Swiss, and French Alps, though its prevalence across the continent remains unknown. Treatment for diphyllobothriasis typically involves the use of standard medications such as niclosamide or praziquantel, which are effective in clearing the parasite.	What could be the condition causing frequent stomach discomfort, nausea, appetite loss, fatigue, and weakness in me, possibly linked to a family history of Cestode infection and associated with vitamin B12 deficiency and abnormal red blood cells resembling Biermer's anemia symptoms?
  [object Object]The provided list appears to be a collection of gene names. Genes are segments of DNA that code for proteins and play a crucial role in various biological functions, influencing traits, growth, and processes within an organism. They are fundamental units of heredity. The presence of these gene names suggests that the document is most likely related to genetic research, medical studies, or bioinformatics. This could involve analyses of genetic sequences, expression patterns, or functional assays related to the specific genes mentioned, possibly with the aim of understanding genetic disorders, development, or disease mechanisms.	Which cellular structures engage in interactions with genes or proteins that are affected by the administration of Mevastatin?

• Loss: MatryoshkaLoss with these parameters:
  json

  1{ 2 "loss": "MultipleNegativesRankingLoss", 3 "matryoshka_dims": [ 4 384 5 ], 6 "matryoshka_weights": [ 7 1 8 ], 9 "n_dims_per_step": -1 10}

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: epoch
• per_device_train_batch_size: 32
• learning_rate: 1e-05
• num_train_epochs: 10
• warmup_ratio: 0.1
• bf16: True
• tf32: False
• load_best_model_at_end: True

All Hyperparameters

Training Logs

• The bold row denotes the saved checkpoint.

Framework Versions

• Python: 3.10.10
• Sentence Transformers: 3.1.1
• Transformers: 4.45.1
• PyTorch: 2.2.1+cu121
• Accelerate: 0.34.2
• Datasets: 3.0.1
• Tokenizers: 0.20.0

Citation

BibTeX

Sentence Transformers

MatryoshkaLoss

MultipleNegativesRankingLoss