SentenceTransformer based on mixedbread-ai/deepset-mxbai-embed-de-large-v1

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: mixedbread-ai/deepset-mxbai-embed-de-large-v1
• Maximum Sequence Length: 512 tokens
• Output Dimensionality: 1024 tokens
• Similarity Function: Cosine Similarity
• Training Dataset:
  • json

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: XLMRobertaModel 
  (1): Pooling({'word_embedding_dimension': 1024, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

Evaluation

Metrics

Information Retrieval

• Dataset: dim_768
• Evaluated with InformationRetrievalEvaluator

Training Details

Training Dataset

json

• Dataset: json
• Size: 1,814 training samples
• Columns: positive and anchor
• Approximate statistics based on the first 1000 samples:

  	positive	anchor
  type	string	string
  details	min: 3 tokens mean: 267.06 tokens max: 512 tokens	min: 15 tokens mean: 39.66 tokens max: 120 tokens

• Samples:

  positive	anchor
  [object Object][object Object]Based on the provided information, it appears you are describing a complex biological system involving various molecules, drugs, diseases, and anatomical structures. Here's a breakdown:[object Object][object Object]### Key Entities[object Object]1. [object Object][object Object] - Mentioned molecules include metabolites, phenols, and drugs, with specific functional groups related to their chemical properties.[object Object] - Targets include enzymes (like acetyl-CoA carboxylase) and diseases causing various health conditions (e.g., Finnish type amyloidosis, lung cancer).[object Object][object Object]2. [object Object][object Object] - The molecules and drugs interact with various biological processes, pathways, and bodily systems.[object Object]	Identify common genetic targets that interact with both N-(3,5-dibromo-4-hydroxyphenyl)benzamide and 1-Naphthylamine-5-sulfonic acid.
  [object Object]The provided list appears to be a collection of gene symbols related to cancer. Gene symbols are used in genetics and molecular biology to identify genes. Each symbol is associated with a specific gene that plays a role in cellular functions, including cancer processes. When studying cancer, researchers often analyze these genes to understand their roles in tumor development, potential as targets for therapy, or as indicators for patient prognosis. For example, some genes listed are known oncogenes or tumor suppressor genes:[object Object][object Object]- TP53: A tumor suppressor gene that when mutated can lead to uncontrolled cell growth.[object Object]- P53, POLD1, PTEN: These are well-known tumor suppressors that help regulate cell division and DNA repair.[object Object]- BRCA	Which anatomical structures lack expression of genes or proteins involved in the homogentisate degradation pathway?
  [object Object][object Object]The gene in question appears to have a wide range of functions across various biological processes and body systems. It's involved in several key areas that regulate cellular responses, metabolic processes, and organ development. Here is a summary of its potential roles:[object Object][object Object]1. [object Object]: The gene contributes to growth control in cells, particularly in smooth muscle cells, and seems to influence cell proliferation, which is essential for tissue repair and development.[object Object][object Object]2. [object Object]: It plays a role in functions like signal transduction, neurotrophin signaling, and regulation of neural activity, suggesting it’s involved in neural health and development.[object Object][object Object]3. [object Object]: There is evidence linking	Identify genes or proteins that interact with angiotensin-converting enzyme 2 (ACE2) and are linked to a common phenotype or effect.

• Loss: MatryoshkaLoss with these parameters:
  json

  1{ 2 "loss": "MultipleNegativesRankingLoss", 3 "matryoshka_dims": [ 4 768 5 ], 6 "matryoshka_weights": [ 7 1 8 ], 9 "n_dims_per_step": -1 10}

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: epoch
• learning_rate: 1e-05
• warmup_ratio: 0.1
• bf16: True
• tf32: False
• load_best_model_at_end: True

All Hyperparameters

Training Logs

• The bold row denotes the saved checkpoint.

Framework Versions

• Python: 3.10.10
• Sentence Transformers: 3.1.1
• Transformers: 4.45.1
• PyTorch: 2.2.1+cu121
• Accelerate: 0.34.2
• Datasets: 3.0.1
• Tokenizers: 0.20.0

Citation

BibTeX

Sentence Transformers

MatryoshkaLoss

MultipleNegativesRankingLoss