SentenceTransformer based on sentence-transformers/all-distilroberta-v1

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: sentence-transformers/all-distilroberta-v1
• Maximum Sequence Length: 512 tokens
• Output Dimensionality: 768 dimensions
• Similarity Function: Cosine Similarity
• Training Dataset:
  • ai-job-embedding-finetuning

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: RobertaModel 
  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

Evaluation

Metrics

Triplet

• Datasets: ai-job-validation and ai-job-test
• Evaluated with TripletEvaluator

Training Details

Training Dataset

ai-job-embedding-finetuning

• Dataset: ai-job-embedding-finetuning at daf4809
• Size: 813 training samples
• Columns: query, job_description_pos, and job_description_neg
• Approximate statistics based on the first 813 samples:

  	query	job_description_pos	job_description_neg
  type	string	string	string
  details	min: 9 tokens mean: 15.84 tokens max: 32 tokens	min: 7 tokens mean: 350.09 tokens max: 512 tokens	min: 7 tokens mean: 351.48 tokens max: 512 tokens

• Samples:

  query	job_description_pos	job_description_neg
  AWS data pipeline design, ETL process implementation, data governance and security.	requirements and design data solutions that meet their needs, including understanding data models/schemas and implementing ETL (Extract, Transform, and Load) processes to transform raw data into a usable format in the destinationResponsible for monitoring and optimizing the performance of data pipelines, troubleshooting any issues that arise, and ensuring data quality and integrity. [object Object][object Object][object Object]Qualifications[object Object][object Object]Proficient in programming languages such as Python and SQL for database querying and manipulation. Strong understanding of AWS services related to data engineering, such as Amazon S3, Amazon Redshift, Amazon Aurora Postgres, AWS Glue, AWS Lambda, AWS Step Function, AWS Lake Formation, Amazon Data Zone, Amazon Kinesis, MSK, and Amazon EMR. Knowledge of database design principles and experience with database management systems. Experience with data storage technologies like relational databases (e.g., SQL Server, PostgreSQL) and distributed storage systems (e.g., PySpark). Understanding of ...	Qualifications:[object Object][object Object]7+ years of experience in data science or analytics roles, with a focus on analytics and machine learning.Expertise in programming languages such as Python, R, or SQL for data extraction, cleaning, and analysis.Expertise in working with machine data / time series data Excellent communication skills to effectively convey complex technical concepts to non-technical stakeholders.Strong analytical and problem-solving skills to derive insights from large datasets.Bachelor's degree in data science, computer science, statistics, or a related field (master’s or PhD preferred)[object Object][object Object]Key Competencies: [object Object][object Object]Expertise in statistics, supervised and unsupervised machine learning techniques and their appropriate uses; ability to apply common modeling best practices to build models using high-volume, asynchronous time series dataStrategic Thinking- Ability to develop and implement a strategic framework on how to deploy Artificial Intelligence within HRCustomer focus- The need to design soluti...
  "Marketing campaign analytics, A/B testing, web analytics tools"	skills to provide best-in-class analytics to the business[object Object][object Object]Required Qualifications, Capabilities, And Skills[object Object][object Object]Bachelor’s and Master’s degree in a quantitative discipline (Data Science/Analytics, Mathematics, Statistics, Physics, Engineering, Economics, Finance or related fields)3+ years of experience in applying statistical methods to real world problems3+ years of experience with SQL and at least one of the following analytical tools: SAS, Python, R Experience with visualization techniques for data analysis and presentationExperience with web analytics tools (Google Analytics, Adobe/Omniture Insight/Visual Sciences, Webtrends, CoreMetrics, etc.)Superior written, oral communication and presentation skills with experience communicating concisely and effectively with all levels of management and partners[object Object][object Object]Preferred Qualifications, Capabilities, And Skills[object Object][object Object]Tableau and Python preferredIntellectually curious and eager to become subject matter expert in their focus areaA strategic thinker w...	Experience in the biotech industry is advantageous. Requirements: Ø Expertise in deep learning techniques, with a focus on Generative AI and Large Language Models (LLMs).Ø Proficiency in Python programming and familiarity with libraries such as TensorFlow, PyTorch, or Keras.Ø Knowledge of cloud computing platforms, particularly AWS.Ø Strong analytical and problem-solving skills.Ø Excellent communication and collaboration abilities.Ø Experience in the biotech industry is a plus. Educational Qualifications: PhD in Computer Science or Machine Learning.
  "Senior Cloud Data Engineer, Databricks, Delta Lake, Data Warehousing"	Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling.• Proficient in developing programs in Python and SQL• Experience with Data warehouse Dimensional data modeling.• Working with event based/streaming technologies to ingest and process data.• Working with structured, semi structured and unstructured data.• Optimize Databricks jobs for performance and scalability to handle big data workloads. • Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks. • Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.• Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process.• Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.[object Object]Qualifications:[object Object]• 5+ years Python coding experience.• 5+ years - SQL...	experience in using, manipulating, and extracting insights from healthcare data with a particular focus on using machine learning with claims data. The applicant will be driven by curiosity, collaborating with a cross-functional team of Product Managers, Software Engineers, and Data Analysts.[object Object][object Object]Responsibilities[object Object][object Object]Apply data science, machine learning, and healthcare domain expertise to advance and oversee Lucina’s pregnancy identification and risk-scoring algorithms.Analyze healthcare data to study patterns of care and patient conditions which correlate to specific outcomes.Collaborate on clinical committee research and development work.Complete ad hoc analyses and reports from internal or external customers prioritized by management throughout the year.[object Object][object Object]Qualifications[object Object][object Object]Degree or practical experience in Applied Math, Statistics, Engineering, Information Management with 3 or more years of data analytics experience, Masters degree a plus.Experience manipulating and analyzing healthcare dat...

• Loss: MultipleNegativesRankingLoss with these parameters:
  json

  1{ 2 "scale": 20.0, 3 "similarity_fct": "cos_sim" 4}

Evaluation Dataset

ai-job-embedding-finetuning

• Dataset: ai-job-embedding-finetuning at daf4809
• Size: 101 evaluation samples
• Columns: query, job_description_pos, and job_description_neg
• Approximate statistics based on the first 101 samples:

  	query	job_description_pos	job_description_neg
  type	string	string	string
  details	min: 10 tokens mean: 16.27 tokens max: 47 tokens	min: 10 tokens mean: 344.34 tokens max: 512 tokens	min: 14 tokens mean: 334.05 tokens max: 512 tokens

• Samples:

  query	job_description_pos	job_description_neg
  Data Engineer, AWS Big Data Services, Oracle EBS, NoSQL Data Sources	experience. Excellent knowledge of database concepts - Defining schemas, relational table structures, SQL querying Proficient with AWS Big data services (Glue, Athena, Redshift, Lake formation, Lambda) Proficient in writing Python code for data pipelines, AWS CDK and data processing logic A standout candidate has working experience with Oracle EBS and Agile PLM data[object Object][object Object]Preferred Skills[object Object][object Object] Experience working with NoSQL data sources at scale (In Terabytes) - Understanding of shards, partitions etc. Understanding of Financial reporting in Oracle EBSWill be exposed to Data Lake, Glue, Lambda and Infrastructure as code. If have that experience is a plus[object Object][object Object]Benefits[object Object][object Object]Company-sponsored Health, Dental, and Vision insurance plans.[object Object][object Object]EQUAL OPPORTUNITY STATEMENT[object Object][object Object]Advantis Global is [object Object][object Object]#AGIT	requirements to support data-driven solutions/decisions.complex data insights in a clear and effective manner to stakeholders across the organization, which includes non-technical audience.informed and stay current on all the latest data science techniques and technologies.for exploring and implementing innovative solutions to improve data analysis, modeling capabilities, and business outcomes.use case design and build teams by providing guidance/ feedback as they develop data science models and algorithms to solve operational challenges. The incumbent must bring these skills/qualifications:Master’s or PhD in Computer Science, Statistics, Applied Mathematics.If degree is in non-related field, must have at least 5 – 7 years’ experience in data science or a similar role.Must be proficient in at least one analytical programming language relevant for data science, such as Python. R will be acceptable. Machine learning libraries & frameworks are a must. Must be familiar with data processing...
  Big Data Engineer, Spark, AWS/GCP, Hadoop	Skills • Expertise and hands-on experience on Spark, and Hadoop echo system components – Must Have • Good and hand-on experience* of any of the Cloud (AWS/GCP) – Must Have • Good knowledge of HiveQL & SparkQL – Must Have Good knowledge of Shell script & Java/Scala/python – Good to Have • Good knowledge of SQL – Good to Have • Good knowledge of migration projects on Hadoop – Good to Have • Good Knowledge of one of the Workflow engines like Oozie, Autosys – Good to Have Good knowledge of Agile Development– Good to Have • Passionate about exploring new technologies – Good to Have • Automation approach – Good to Have [object Object]Thanks & RegardsShahrukh KhanEmail: [object Object]	Requirements: We're looking for a candidate with exceptional proficiency in Google Sheets. This expertise should include manipulating, analyzing, and managing data within Google Sheets. The candidate should be outstanding at extracting business logic from existing reports and implementing it into new ones. Although a basic understanding of SQL for tasks related to data validation and metrics calculations is beneficial, the primary skill we are seeking is proficiency in Google Sheets. This role will involve working across various cross-functional teams, so strong communication skills are essential. The position requires a meticulous eye for detail, a commitment to delivering high-quality results, and above all, exceptional competency in Google Sheets[object Object][object Object]Google sheet knowledge is preferred.Strong Excel experience without Google will be considered.Data Validation and formulas to extract data are a mustBasic SQL knowledge is required.Strong communications skills are requiredInterview process...
  Data Scientist, time series surveillance, production operations, data pipeline design	Experience in Production Operations or Well Engineering Strong scripting/programming skills (Python preferable)[object Object][object Object]Desired: [object Object][object Object] Strong time series surveillance background (eg. OSI PI, PI AF, Seeq) Strong scripting/programming skills (Python preferable) Strong communication and collaboration skills Working knowledge of machine learning application (eg. scikit-learn) Working knowledge of SQL and process historians Delivers positive results through realistic planning to accomplish goals Must be able to handle multiple concurrent tasks with an ability to prioritize and manage tasks effectively[object Object][object Object][object Object][object Object]Apex Systems is [object Object][object Object]Apex Systems is a world-class IT services company that serves thousands of clients across the globe. When you join Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in man...	SKILLS:1. Work experience in a Human Services agency ideally related to human services programs including Electronic Benefits Transfer (EBT) including SNAP and TANF benefits.2. Experience with Quick Base platform and SQL.[object Object]3. Strong proficiency in data science tools such as R or Python. Experience with data visualization tools such as Tableau or Power BI[object Object] 4. Ability to transform issuance and notices files.[object Object] [object Object]Responsibilities[object Object]1. Data analysis and modelling, including Designing and developing machine learning and predictive models and algorithms.[object Object]Performing exploratory data analysis to identify patterns and trends.Developing and maintaining database and data systems to support business needs.Interpreting and communicating data analysis results to stakeholders.Collaborating with other teams to develop and implement data-driven solutions.2. Data management and governance, including Ensuring compliance with data privacy regulations and company data governance policies.[object Object]Developing and impleme...

• Loss: MultipleNegativesRankingLoss with these parameters:
  json

  1{ 2 "scale": 20.0, 3 "similarity_fct": "cos_sim" 4}

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: steps
• per_device_train_batch_size: 16
• per_device_eval_batch_size: 16
• learning_rate: 2e-05
• num_train_epochs: 1
• warmup_ratio: 0.1
• batch_sampler: no_duplicates

All Hyperparameters

Training Logs

Framework Versions

• Python: 3.10.19
• Sentence Transformers: 3.3.1
• Transformers: 4.48.0
• PyTorch: 2.10.0
• Accelerate: 1.12.0
• Datasets: 4.5.0
• Tokenizers: 0.21.4

Citation

BibTeX

Sentence Transformers

MultipleNegativesRankingLoss