This is a sentence-transformers model finetuned from sentence-transformers/paraphrase-mpnet-base-v2. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

Model Type: Sentence Transformer
Base model: sentence-transformers/paraphrase-mpnet-base-v2
Maximum Sequence Length: 512 tokens
Output Dimensionality: 768 dimensions
Similarity Function: Cosine Similarity

Model Sources

Documentation: Sentence Transformers Documentation
Repository: Sentence Transformers on GitHub
Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: MPNetModel 
  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

python

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
sentences = [
    "Professional BackgroundCertified Coding Specialists (CCS) with E/M, outpatient, in patient/ER admits, diagnostic, procedural /pro fee Coding, CMS-DRG, VBP, CPT II codes, HEDIS, HCC, RAF, data analyst and quality auditing in health management programs, ICD 10 Certified. \xa05 Years experience in Administration/ Office management and as Coding/billing manager.  Licensed EMT-I since 2002.  10+ years' experience in billing and 6 years coding experience, 3rd Party insurance follow up which include commercial, work comp, VA, Medicare, Medicaid, appeals, insurance verification, authorizations. 5+ years Clinical as a Medical Assistant, phone triage, in office surgical procedures.   I have a total of 18 years working in the medical field and VERY customer service oriented. Knowledgeable with various different EMR, EHR systems, Cerner, Centricity, Athena, Allmeds to name a few. Excel, Word, Outlook,Salesforce. I have two secret Government clearances given 1985 still active thru the Department of Defense so all my background checks run smoothly and pass with flying colors.\nSkill HighlightsCCSAttestationsSDSHEDIS/Quality measuresHCCCMS-DRGOut patinetSkilled nursingHome healthRAFVBPCPT II codesICD- 10EPRGSales forceWordExcelOutlook10 Key by touch62 WMP typingEpicPulseencoderCernerAllmedsEMR/EHR\nEducation and TrainingEdison Community college,Expected in2002––Allied Health Business college ICD 10, Certified Coding Specialists\nCurrent: NAHP, AHIMA & AAPC memberships.:Emergency Medical Services-GPA:Emergency Medical Services\nProfessional ExperienceAltium-CMS / HHCS/ HEDIS/Coding/ data analyst and quality coordinatorLa Jolla,CA,06/2016-CurrentReview, obtain data extracted remotely and on site physician medical records to analyze quality and outcome of health management programs, quality, pharmacy, Financial, claims, coding, helping to locate where providers need to close gaps, information missing to maintain highest ratings and help with SDS/attestation submission. Knowledgeable with many different EMR systems, HHCS, RAF, HEDIS, CMS DRG CPT II, Coding guidelines. Our goal is to see that the physician receives any and all monies available to them and to help them provide the best possible healthcare to our members. We provide training to the offices where they may need help in closing these gapsDr MT Pally MD Cardiologist-Coder/Billing ManagerCity,STATE,04/2015-2016Performed daily charge entry, review and obtained codes using MS-DRG, VBP, HCC, RAF, HEDIS quality auditing/guidelines, Coding for all office visit, inpatient hospital visits, tests, ER admits, Echo's/Vascular, Nuclear stress Testing, PET Scan and all nursing home, home health visits. Query physician and tech for any missing or incomplete documentation, maintaining a high productivity standard with 95%+ accuracy, working denials, letters of appeals. Assisting the front desk whenever needed, answering phones, scheduling appointments, verifying insurance's, obtaining authorizations. \xa0Ali XXX XXX 9550Tenet Health Catawba Cariothoracic Surgeons-Coder/Front Office Coordinator/coderCity,STATE,08/2014-03/2015Check in/check out, scheduling, phone triage, insurance verification, insurance authorizations, Medical assisting, room patients, obtain vitals, chart documentation, Reviewed and code entry using MS-DRG, VBP, HCC, RAF, HEDIS quality/guidelines, answering high volume calls, data entry in Nex Gen *EMR, managing medical records, surgical boarding, collecting copays, deposits and provide quality customer service.800 367 2884 Ann Marie.HMA/Physicans Regional Hosptial-Coder/Insurance verification specialistsCity,STATE,07/2013-08/2014Reviewed and corrected Coding using the MS-DRG, VBP, HEDIS quality auditing/ guidelines for all the high cost surgical procedures, verified and authorized insurance, quote patient pricing, answer any patient questions regarding insurance, pricing or procedure, data entry in EMR system, team player and provide excellent customer service. Stacy 704-660-4584.Centura Health Systems-Coder/Patient Account RepresentativeCity,STATE,07/2010-01/2013Answered high volume patient's questions, insurance verification, data entry in Meditech, work insurance collections, 3rd party follow up, query physicians and tech for missing or clarification of documentation, corrected coding issues, performed paper and electronic billing, correct ICD-9 CPT coding using MS-DRG, VBP, HCC, RAF, HEDIS quality auditing/guidelines for accounts receivables, and provide excellent customer service.Was a rehire Tawyna Scott XXX-715 7000.The Swedish Hospital-Medical Assistant/EMT at Hand Surgery Associates atCity,STATE,09/2009-05/2010Triage and room patients, provided assessment of injury/wounds, removed sutures, dressings, applied casts and splints, assisted with surgical procedures, and performed data entry in EMR and provide excellent customer service.Kim Beard XXX 744 7078.Associates Of Otolaryngology-Medical Assistant/EMT at Associates of OtolaryngologyCity,STATE,04/2008-06/2009High volume phone triage, greet and room patients, obtained vitals, performed data entry in EMR system, in room scribe, assisted with office surgical procedures, ICD-9, CPT coding, transcription, injections, biopsies, cultures, lab and radiology orders, Team player and performed excellent customer service.Diana Mcleron XXX 744 1961Press O Matic Keyless Locks-Office ManagerCity,STATE,2005-2008Manage front office, answered phones, assist with phone sales and walk in sales, invoicing, shipping and receiving, A/R, A/P, quick books, handled monthly inventory, ordering, restocking, some assembly of production line when needed, faxed, filed, copier, 10 key by touch, 62 WPM typing, some soft collections. Outlook, Excel, Word. \xa0Dave Campbell \xa0XXX 762 7373.Lee Health-Out patient registration/Central SchedulingCity,STATE,10/2001-01/2005Handled large volume of patient calls scheduling patients for all out patient testing, obtaining correct dr orders with correct coding. \xa0Obtained and data entry correct patient demographics insurance information at time of out patient testing, verified insurance information, collected co payments, assisted patients to areas of testing. \xa0provide excellent customer service.21st Century Oncology-Biller/customer service/payment posterCity,STATE,10/1998-10/2001Posted large insurance checks and patient payments to correct DOS in accounts, balance daily, answered patient questions regarding billing/accounts, worked 3rd party denials, timely filing, letters of appeals for Medicare, Medicaid, VA, work comp, commercial insurances, corrected coding errors. worked with patients on payment agreements and soft collections, met daily productivity goals, provided excellent customer service.\nSkills10 key by touch, accounts receivables, RAF, Anatomy, AP, scheduling appointments, AR, auditing, billing, Bookkeeping, Call center, Cardiologist, closing, CMS, CPT II, CPT coding, CPT, excellent customer service, customer service, data analyst, data analysis, data entry, documentation, faxing, filing, Financial, Front Office, home health, ICD 10, ICD-9, injections, Insurance, inventory, invoicing, letters, Director, managing 5, managing, Medical assisting, Medical Manager, Medical Terminology, Meditech, meetings, Excel, Office, Outlook, Word, Nursing, nursing home, ordering office supplies, outside sales, payment processing, pharmacology, Physiology, pricing, processes, Coding, Quality, quick, Quickbooks, radiology, sales, Scheduling, shipping, spread sheet, Supervisor, Surgery, Team player, answering phones, phones, phone, transcription, Triage, phone triage, typing, wound care.",
    'Infomatics is an Inc 5005000 corporation for the last 7 years in a row. We have an urgent need for a Business Analyst in Pontiac, MI. Please find the job details below. \nTitle: Business AnalystLocation: Pontiac, MIDuration: Long Term Contract \nDescription: Client is seeking an experienced business analyst to join the Application Services team working in a hybrid work environment. We are seeking a hands-on, self-starter, critical thinking team player possessing both general technical knowledge and interpersonal skills. Experienced in implementing process re-engineering, developing business requirements, use cases and test scripts using industry accepted practices. Should possess high level understanding of information technology concepts as well as the SDLC methodology. Must be flexible and able to multi-task, working on multiple projects and internal initiatives, inclusive of upgrades, maintenance, and enhancements. Under supervision, conducts business process analyses and needs assessments to align information technology solutions with the business initiatives. Supports analytical functions by assisting programmers in ascertaining user needs and adapting user procedures to final program design. Organizes and facilitates application testing and user acceptance to ensure business communitys needs are met. Acts as second and third level support for Production incidents and facilitates troubleshooting and close out of reported issues for multiple applications. Utilizes current county-wide andor department specific software to complete assignments.\nExperience Level: 4+ years\nStart Date: 09182023.Duration: 2+ years\nEnvironment: Azure DevOps, MS Visio, MS Office Suite\n\nIf you have the above skillsexperience, please share your resume in confidence to:\nRecruiter Name: Sravan KumarEmail: sravan@infomatinc.com\nEOE',
    'Solstice Consulting Group is seeking a Senior Software Engineer (C++) for an energy related client in the South Houston Area. Base $110k - $135k DOE, 15% bonus opportunity and excellent benefitsCANDIDATES MUST BE US CITIZEN OR GREEN CARD ONLYMinimum of 5+ years of recent C++ experience required Produce, debug, and implement functional software solutions and work with management to define software requirements. Execute full software development life cycle (SDLC). Work with internal field service teams to identify and solve issues related to software systems and help collect needed software improvements. MAIN TASKS Develop high-quality software design and architectureIdentify, prioritize, and execute tasks in the software development life cycleAutomate tasks through appropriate tools and scriptingReview and debug codePerform validation and verification testingCollaborate with internal users to improve productsClearly document project requirements, develop project proposals, assist in developing use manuals and any other technical informationAbility to work on multiple projects at the same time QUALIFICATIONS: Bachelors Degree in Computer Science or equivalent experience in related field.7+ years of experience in a similar role with designing, programming, debugging, testing, and supporting multiple product lines.5+ years experience with selected programming languages (C++)Experience with Python, JavaScript, PHP preferredIn-depth knowledge of PostgreSQL or other relational databasesFamiliarity with the Linux operating systemFamiliarity with version control system (GitBitbucket)Analytical mind with problem-solving aptitudeAbility to work independently and as part of an integrated teamExcellent organizational skills',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]

Training Details

Training Dataset

Unnamed Dataset

Size: 6,241 training samples
Columns: sentence_0, sentence_1, and label
Approximate statistics based on the first 1000 samples:
sentence_0 sentence_1 label
type string string float
details
min: 321 tokens
mean: 506.75 tokens
max: 512 tokens
min: 16 tokens
mean: 384.91 tokens
max: 512 tokens
min: 0.0
mean: 0.36
max: 1.0

Samples:

sentence_0	sentence_1	label
Career OverviewSoftware developer adept at application development, testing and optimization. Excels at dot net application development, including coordinating ground-up planning, programming and implementation for core modules.[object Object]QualificationsOperating Systems: Windows 95/98/2000/xp/2003/7 Programming Languages: C#, ASP.Net, ASP, VB.NET, C Dot Net Technologies: Net Framework 4.5/4/3.5/3.0/2.0/1.1, ASP.NET, VB.NET, ADO.NET, Ajax Web Technologies: HTML, DHTML, CSS, XML Web Server: IIS (Internet Information Server) Databases: Microsoft SQL Server 2000/2005/2008/2010/2012, MS Access, PL/SQL MS Framework: NET Framework 4.5/4.0/3.5/3.0/2.0 Designing Tools: Visual Studio.NET (2003/2005/2008/2010/2012), MS Front Page, Graphic design, Adobe Dreamweaver, Adobe Flash, Adobe Photoshop and Coral Draw Scripting Language: VB Script, Java Script Reporting: MS SQL Reporting Services (SSRS), Crystal Reports[object Object]Work Experience08/2013toCurrentSoftware DeveloperHp Inc–Olympia,WA,It is 24/7 home shopping and e...	A Senior Software Engineer at O'Reilly Auto Parts develops and supports applications for internal and external systems including Inventory, Supply Chain, eCommerce, Retail Applications, Enterprise Search and more. Our teams are focused on the development, design and integration of various software systems, databases, and third-party packages utilizing tools and technologies including Java, JavaScript, Spring, Hibernate, and SQL. This particular position will be a full stack role working on Warehouse Management Applications; however, we will consider anyone with Supply Chain Application Development experience.[object Object]The base salary for this position is $116,000-$145,000 annually plus a 10% Annual Bonus. Exact compensation will be determined based on experience, however mid point around $126,000 - $131,000 would be more practical.[object Object]What You'll Do:Partner with key stakeholders to develop new features and enhance and support existing applications and programs.Work with business systems analysts a...	`1.0`
SummaryProfessional accountant with an outstanding work ethic and integrity seeking to make a valuable contribution utilizing strong analytical, organizational, communication, and computer skills. Summa Cum Laude graduate with BBA in Accounting[object Object]Eight years of accounting experience[object Object]Three years of public accounting experience in governmental auditing[object Object]Five years of private industry accounting and tax experience[object Object]Experience utilizing Microsoft Office, Microsoft Dynamics AX, CaseWare, Ohio Auditor of State GAAP Reporting System, OneSource, SBT, SysPro, and Crystal Reports[object Object]*Ohio Notary Public (Commission expires February 15, 2021)[object Object]SkillsAnalytical reasoningCompliance testing knowledgeEffective time managementPublic and private accountingStrong organizational skillsGeneral ledger accountingSuperior research skillsFlexible team player[object Object]Education and TrainingKent State UniversityKent,OhioExpected in––Bachelor of Business Administration:Accounting-GPA:Accounting Graduated Summa Cum Laude 3.84 ...	Position Title: Senior Accountant Organization: Jewish Family Service of San Diego Department: Family and Community Services Division Organization: Jewish Family Service of San Diego Position Type: Full-Time (37.5+ hoursweek), Exempt Salary: $82,000 - $88,000year Total Compensation: In addition to standard pay, compensation for this position includes: Comprehensive, low-cost healthcare coverage for employees Generous employer 401(k) contributions Employer-covered life insurance Time Away from Work: Being able to take time away from work is critical in bringing your best self to work. Time off benefits for this position include: Generous paid vacation time and sick leave 17 paid holidays, including Federal, Jewish, and floating holidays 2 Wellness Days to be taken any time during the year to support employees mental wellness Position Overview:The Senior Accountant is an integral part of the financial planning function within the Finance & Accounting Team. The position works closely with...	`0.5`
Professional SummaryHighly motivated Sales Associate with extensive customer service and sales experience. Outgoing sales professional with track record of driving increased sales, improving buying experience and elevating company profile with target market.[object Object]SkillsQuickBooks, CCH ATX, Microsoft Office Suiteaccount reconciliation, accounting, administrative, bookkeeping, C, CA, consulting, contracts, credit, client, clients, documentation, filing, financial analysis, forms, funds, general ledger, MA, Mandarin, marketing, Excel, Microsoft Office Suite, payroll, QuickBooks, real estate, reporting, sales, tax compliance, tax, taxes, tax returns, telemarketing, venture capital[object Object]Work History01/2016toCurrentTax AccountantE. & J. Gallo Winery	Houston,TX,Prepared and reviewed hundreds of federal and multi-state tax returns for Individuals, Partnerships, LLCs, S Corporations, and C Corporations (1040/1040NR/1120/1120S/1065, AZ/ CA/ DE/ FL/ IL/ MA/ MN / NY/ WI state filing) Conducted con...	Position: Junior AccountantDepartment: Finance & AdministrationReports to: ControllerFLSA Status: Exempt[object Object]JOB SUMMARYThe Junior Accountant will perform accounting duties related to the efficient maintenance and processing of accounts payable transactions. She will review and analyze expense reports, work with vendors to resolve invoices, and reconcile monthly vendor statements. The Junior Accountant will administer the corporate card account activities and reconcile monthly statements.[object Object]MEASURE(S) OF SUCCESS Accuracy while managing a high volume of invoice and journal entry transactions. Time required to complete assigned tasks for month-end close. Meeting all deadlines for escheatment filings. Resolve outstanding checks by collaborating with the billing team.[object Object]COMPETENCIESAdaptability - Employee is open to new ideas and ways of doing business and adopts change willingly.Communication - Employee expresses thoughts and ideas in a clear and effective manner. Employee communicates directly a...

Loss: CosineSimilarityLoss with these parameters:
json
1{ 2 "loss_fct": "torch.nn.modules.loss.MSELoss" 3}

Training Hyperparameters

Non-Default Hyperparameters

per_device_train_batch_size: 16
per_device_eval_batch_size: 16
multi_dataset_batch_sampler: round_robin

All Hyperparameters

Click to expand

overwrite_output_dir: False
do_predict: False
eval_strategy: no
prediction_loss_only: True
per_device_train_batch_size: 16
per_device_eval_batch_size: 16
per_gpu_train_batch_size: None
per_gpu_eval_batch_size: None
gradient_accumulation_steps: 1
eval_accumulation_steps: None
torch_empty_cache_steps: None
learning_rate: 5e-05
weight_decay: 0.0
adam_beta1: 0.9
adam_beta2: 0.999
adam_epsilon: 1e-08
max_grad_norm: 1
num_train_epochs: 3
max_steps: -1
lr_scheduler_type: linear
lr_scheduler_kwargs: {}
warmup_ratio: 0.0
warmup_steps: 0
log_level: passive
log_level_replica: warning
log_on_each_node: True
logging_nan_inf_filter: True
save_safetensors: True
save_on_each_node: False
save_only_model: False
restore_callback_states_from_checkpoint: False
no_cuda: False
use_cpu: False
use_mps_device: False
seed: 42
data_seed: None
jit_mode_eval: False
use_ipex: False
bf16: False
fp16: False
fp16_opt_level: O1
half_precision_backend: auto
bf16_full_eval: False
fp16_full_eval: False
tf32: None
local_rank: 0
ddp_backend: None
tpu_num_cores: None
tpu_metrics_debug: False
debug: []
dataloader_drop_last: False
dataloader_num_workers: 0
dataloader_prefetch_factor: None
past_index: -1
disable_tqdm: False
remove_unused_columns: True
label_names: None
load_best_model_at_end: False
ignore_data_skip: False
fsdp: []
fsdp_min_num_params: 0
fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
tp_size: 0
fsdp_transformer_layer_cls_to_wrap: None
accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
deepspeed: None
label_smoothing_factor: 0.0
optim: adamw_torch
optim_args: None
adafactor: False
group_by_length: False
length_column_name: length
ddp_find_unused_parameters: None
ddp_bucket_cap_mb: None
ddp_broadcast_buffers: False
dataloader_pin_memory: True
dataloader_persistent_workers: False
skip_memory_metrics: True
use_legacy_prediction_loop: False
push_to_hub: False
resume_from_checkpoint: None
hub_model_id: None
hub_strategy: every_save
hub_private_repo: None
hub_always_push: False
gradient_checkpointing: False
gradient_checkpointing_kwargs: None
include_inputs_for_metrics: False
include_for_metrics: []
eval_do_concat_batches: True
fp16_backend: auto
push_to_hub_model_id: None
push_to_hub_organization: None
mp_parameters:
auto_find_batch_size: False
full_determinism: False
torchdynamo: None
ray_scope: last
ddp_timeout: 1800
torch_compile: False
torch_compile_backend: None
torch_compile_mode: None
include_tokens_per_second: False
include_num_input_tokens_seen: False
neftune_noise_alpha: None
optim_target_modules: None
batch_eval_metrics: False
eval_on_start: False
use_liger_kernel: False
eval_use_gather_object: False
average_tokens_across_devices: False
prompts: None
batch_sampler: batch_sampler
multi_dataset_batch_sampler: round_robin

Training Logs

Epoch	Step	Training Loss
1.2788	500	0.1164
2.5575	1000	0.0739

Framework Versions

Python: 3.11.12
Sentence Transformers: 3.4.1
Transformers: 4.51.3
PyTorch: 2.6.0+cu124
Accelerate: 1.5.2
Datasets: 3.5.0
Tokenizers: 0.21.1

Citation

BibTeX

Sentence Transformers

bibtex

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

	sentence_0	sentence_1	label
type	string	string	float
details	min: 321 tokens mean: 506.75 tokens max: 512 tokens	min: 16 tokens mean: 384.91 tokens max: 512 tokens	min: 0.0 mean: 0.36 max: 1.0

ennygaebs/cv-job-matcher

SentenceTransformer based on sentence-transformers/paraphrase-mpnet-base-v2