This model is used to predict ACE2 binding affinities with mutant SARSCoV-2 Omicron XBB.1.5 variants spike receptor-binding domain (RBD).

protein level regression

The dataset is from Deep mutational scans of XBB.1.5 and BQ.1.1 reveal ongoing epistatic drift during SARSCoV-2 evolution.

Label means binding affinities level, ranging from minus infinity to positive infinity. Zero means no affinity, lager means higher affinity and smaller means lower affinity.

Amino acid sequence

0.71 Spearman's ρ

lora_dropout: 0.0

lora_alpha: 16

target_modules: ["query", "key", "value", "intermediate.dense", "output.dense"]

modules_to_save: ["classifier"]

class: AdamW

betas: (0.9, 0.98)

weight_decay: 0.01

learning rate: 1e-4

epoch: 50

batch size: 100

precision: 16-mixed