SentenceTransformer based on BAAI/bge-small-en-v1.5

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: BAAI/bge-small-en-v1.5
• Maximum Sequence Length: 512 tokens
• Output Dimensionality: 384 dimensions
• Similarity Function: Cosine Similarity

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': True}) with Transformer model: BertModel 
  (1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

Evaluation

Metrics

Information Retrieval

• Dataset: val_evaluator
• Evaluated with InformationRetrievalEvaluator

Training Details

Training Dataset

Unnamed Dataset

• Size: 3,507 training samples
• Columns: anchor, positive, and negative
• Approximate statistics based on the first 1000 samples:

  	anchor	positive	negative
  type	string	string	string
  details	min: 4 tokens mean: 11.76 tokens max: 32 tokens	min: 8 tokens mean: 116.82 tokens max: 504 tokens	min: 19 tokens mean: 121.15 tokens max: 424 tokens

• Samples:

  anchor	positive	negative
  Where are the shuttle bus pickup points located within the Kumbh Mela grounds?	No, shuttle buses will not have dedicated volunteers specifically, but for assistance, you can reach out to the nearest information center.	The ancient art of weaving has captivated many cultures worldwide. In some regions, artisans use intricate patterns to tell stories, while others focus on vibrant colors that highlight their heritage. Experimentation with different materials can yield unique textures, adding depth to the final product. Workshops often provide insights into traditional techniques, ensuring these skills are passed down through generations.
  Hotel Ilawart start place	Is hotel pickup and drop-off available for the tours?[object Object] Fixed pickup points, such as Hotel Ilawart, are provided for all tours. In some cases, pickup and drop-off can be arranged for locations within a 5 km radius of the starting point, but you must confirm this with the tour operator at the time of booking.	What all is included in the trip package?[object Object]The trip package typically includes transportation, tour guide services, and breakfast. Meals such as lunch and dinner can be purchased separately. Hotel bookings are usually not included in the package, so you will need to arrange accommodation independently.
  Are there food stalls or restaurants at the Railway Junction that cater to dietary restrictions for pilgrims?	Yes, there are food stalls and restaurants available at the Railway Junction that cater to various dietary needs, including vegetarian and other dietary restrictions suitable for pilgrims.	The sound of the ocean waves rhythmically crashing against the shore creates a soothing symphony that invites relaxation. Seagulls soar above, occasionally diving down to catch a glimpse of fish beneath the surface. Beachgoers spread out their colorful towels, soaking up the sun's golden rays while children build sandcastles, their laughter mingling with the salty breeze. A distant sailboat glides across the horizon, hinting at adventures beyond the vast expanse of blue. As the sun sets, the sky transforms into a canvas of vibrant hues, signaling the end of another beautiful day by the sea.

• Loss: GISTEmbedLoss with these parameters:
  json

  1{'guide': SentenceTransformer( 2 (0): Transformer({'max_seq_length': 256, 'do_lower_case': False}) with Transformer model: BertModel 3 (1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True}) 4 (2): Normalize() 5), 'temperature': 0.01}

Evaluation Dataset

Unnamed Dataset

• Size: 877 evaluation samples
• Columns: anchor, positive, and negative
• Approximate statistics based on the first 877 samples:

  	anchor	positive	negative
  type	string	string	string
  details	min: 5 tokens mean: 12.21 tokens max: 32 tokens	min: 3 tokens mean: 115.93 tokens max: 471 tokens	min: 15 tokens mean: 118.09 tokens max: 422 tokens

• Samples:

  anchor	positive	negative
  Ganga bath benefit	What is the ritual of Snan or bathing?[object Object] Taking bath at the confluence of Ganga, Yamuna and invisible Saraswati during Mahakumbh has special significance. It is believed that by bathing in this holy confluence, all the sins of a person are washed away and he attains salvation.[object Object] [object Object] Bathing not only symbolizes personal purification, but it also conveys the message of social harmony and unity, where people from different cultures and communities come together to participate in this sacred ritual.[object Object] [object Object] It is considered that in special circumstances, the water of rivers also acquires a special life-giving quality, i.e. nectar, which not only leads to spiritual development along with purification of the mind, but also gives physical benefits by getting health. [object Object] List of Aliases: [['Snan', 'bathing'], ]	What benefits will I get by attending the Kumbh Mela?[object Object]It is believed that bathing in the holy rivers during this time washes away sins and grants liberation from the cycle of life and death.[object Object] [object Object] Attending the Kumbh and taking a dip in the sacred rivers provides a unique opportunity for spiritual growth, purification, and selfrealization. ✨
  Guide provide what	What is the guide-to-participant ratio for each tour?[object Object] Each tour is led by one guide per group, ensuring a personalized experience with ample opportunity for detailed insights and engagement. The guide will provide context, historical background, and answer any questions during the tour, offering a rich, informative experience for participants.	How many people can join a group tour?[object Object]Group sizes depend on the type of vehicle selected. For instance, a Dzire accommodates up to 4 people, an Innova is suitable for 5-6 people, and larger groups (minimum 10 people) can travel in a Tempo Traveller. For even larger groups, multiple vehicles can be arranged to ensure everyone can travel together comfortably.
  How many rules must a Kalpvasi observe?	A Kalpvasi must observe 21 rules during Kalpvas, involving disciplines of the mind, speech, and actions.	The dancing colors of autumn leaves create a tapestry of nature’s beauty, inviting every eye to witness the grandeur of the changing seasons. Every gust of wind carries a whisper of nostalgia as trees shed their vibrant garments.

• Loss: GISTEmbedLoss with these parameters:
  json

  1{'guide': SentenceTransformer( 2 (0): Transformer({'max_seq_length': 256, 'do_lower_case': False}) with Transformer model: BertModel 3 (1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True}) 4 (2): Normalize() 5), 'temperature': 0.01}

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: steps
• per_device_train_batch_size: 16
• gradient_accumulation_steps: 2
• learning_rate: 1e-05
• weight_decay: 0.01
• num_train_epochs: 30
• warmup_ratio: 0.1
• load_best_model_at_end: True

All Hyperparameters

Training Logs

Framework Versions

• Python: 3.10.12
• Sentence Transformers: 3.3.0
• Transformers: 4.46.2
• PyTorch: 2.5.1+cu121
• Accelerate: 1.1.1
• Datasets: 3.1.0
• Tokenizers: 0.20.3

Citation

BibTeX

Sentence Transformers

GISTEmbedLoss