worksphere

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: BAAI/bge-base-en-v1.5
• Maximum Sequence Length: 512 tokens
• Output Dimensionality: 768 dimensions
• Similarity Function: Cosine Similarity

• Language: en
• License: apache-2.0

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': True}) with Transformer model: BertModel 
  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

Evaluation

Metrics

Information Retrieval

• Datasets: dim_1024, dim_768, dim_512 and dim_256
• Evaluated with InformationRetrievalEvaluator

Training Details

Training Dataset

Unnamed Dataset

• Size: 17,198 training samples
• Columns: question and context
• Approximate statistics based on the first 1000 samples:

  	question	context
  type	string	string
  details	min: 14 tokens mean: 26.6 tokens max: 57 tokens	min: 23 tokens mean: 140.8 tokens max: 259 tokens

• Samples:

  question	context
  Are there any specific guidelines or requirements for the installation of tree supports as outlined in the regulations?	SECTION 32 93 00:[object Object]Cast-in-Place 31 25 14 - Erosion and 32 13 13 - Concrete Paving. 32 13 16 - Decorative Concrete. a. Measurement 1) Measured per each Tree planted. b. Payment 1) The work performed and materials and measured as provided under price bid per each for Tree 2) Various caliper inches. The price bid shall include: 1) Furnishing and installing Tree as 2) Preparing excavation pit 3) Topsoil, fertilizer, mulch, and planting mix, 1 = . , 1 = Tree. , 1 = furnished in accordance with this item "Measurement" will be paid for at the unit for:. planted, 1 = . specified, 1 = . by the Drawings, 1 = . supports, 1 = . [Insert Bid Number], 1 = . [Insert, 1 = . 4), 1 = Plant. Number], 1 = Number]. Engineering Project, 1 = Engineering Project[object Object]Effective July 1, 2024[object Object]32 93 00[object Object]PLANTINGS[object Object]Page 2 of 24[object Object]eee[object Object]BER[object Object]BPRERR
  What specific information do I need to include in my application to meet the standards for grouted installations?	1.1 SUMMARY:[object Object]= . 36, 2 = . 36, 3 = (1) requirements a qualified testing laboratory.. 37, 1 = . 37, 2 = . 37, 3 = Submit a minimum of 3 other similar projects where the proposed grout mix. 38, 1 = . 38, 2 = . 38, 3 = design was used.. 39 40, 1 = . 39 40, 2 = . 39 40, 3 = anticipated volumes of grout to be pumped for each. , 1 = . , 2 = . , 3 = Submit application and reach grouted.. 41, 1 = 4.. 41, 2 = . 41, 3 = Additional requirements for installations of carrier pipe 24-inch and larger:. 42, 1 = . 42, 2 = a.. 42, 3 = Submit work plan describing the carrier pipe installation equipment, materials. 43 44, 1 = . 43 44, 2 = b.. 43 44, 3 = employed. For installations without holding jacks or a restrained spacer, provide buoyant[object Object]CITY OF DENTON STANDARD CONSTRUCTION SPECIFICATION DOCUMENTS Revised October 22, 2020 Effective July 1, 2024[object Object][Insert Engineering Project Number] [Insert Bid Number][object Object]eK[object Object]BWN[object Object]nA[object Object]20[object Object]21[object Object]22[object Object]23[object Object]24
  In the event of a quasi judicial hearing, who else besides the site owner(s) should we inform about the decision notification process, and how do we manage their requests for a copy of the decision?	Notice of Decision:[object Object]1. Within 10 days after a final decision on an application, the Director shall provide written notification of the decision, unless the applicant was present at the meeting where the decision was made or required by law.[object Object]2. If the review involves a quasi-judicial hearing, the Director shall, within 10 days after a final decision on the application, provide a written notification of the decision to the owner(s) of the subject site (unless the applicant was present at the meeting where the decision was made or required by law), and any other person that submitted a written request for a copy of the decision before its effective date.

• Loss: MatryoshkaLoss with these parameters:
  json

  1{ 2 "loss": "MultipleNegativesRankingLoss", 3 "matryoshka_dims": [ 4 768, 5 512, 6 256 7 ], 8 "matryoshka_weights": [ 9 1, 10 1, 11 1 12 ], 13 "n_dims_per_step": -1 14}

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: epoch
• per_device_train_batch_size: 32
• per_device_eval_batch_size: 16
• gradient_accumulation_steps: 16
• learning_rate: 2e-05
• num_train_epochs: 8
• lr_scheduler_type: cosine
• warmup_ratio: 0.1
• bf16: True
• tf32: True
• load_best_model_at_end: True
• optim: adamw_torch_fused
• batch_sampler: no_duplicates

All Hyperparameters

Training Logs

• The bold row denotes the saved checkpoint.

Framework Versions

• Python: 3.11.10
• Sentence Transformers: 3.3.1
• Transformers: 4.41.2
• PyTorch: 2.4.1+cu124
• Accelerate: 1.3.0
• Datasets: 2.19.1
• Tokenizers: 0.19.1

Citation

BibTeX

Sentence Transformers

MatryoshkaLoss

MultipleNegativesRankingLoss