You can deploy this model and start earning money today!

youssefkhalil320/
clinical-sts-NeuML-pubmedbert-base-embeddings

Name: clinical-sts-NeuML-pubmedbert-base-embeddings
Availability: InStock

NeuML/pubmedbert-base-embeddings

finetune

Views

No views yet

Clinical STS Regression Model

Fine-tuned from NeuML/pubmedbert-base-embeddings on a clinical text-pair similarity dataset.

Training config

json

{
  "train": "./med_sts/clinicalSTS.train.txt",
  "test": "./med_sts/clinicalSTS.test.txt",
  "model": [
    "NeuML/pubmedbert-base-embeddings"
  ],
  "epochs": 20,
  "batch_size": 16,
  "lr": 2e-05,
  "weight_decay": 0.01,
  "warmup_ratio": 0.1,
  "max_grad_norm": 1.0,
  "dropout": 0.1,
  "max_len": 256,
  "seed": 42,
  "patience": 5,
  "output_dir": "./sts_val/clinical-sts-NeuML-pubmedbert-base-embeddings",
  "wandb_project": "clinical-sts",
  "hf_repo": "youssefkhalil320/clinical-sts-NeuML-pubmedbert-base-embeddings"
}

youssefkhalil320/clinical-sts-NeuML-pubmedbert-base-embeddings

Clinical STS Regression Model

Training config

Best test Spearman ρ: 0.7766

youssefkhalil320/
clinical-sts-NeuML-pubmedbert-base-embeddings

Best test Spearman ρ: `0.7766`