This model is used to predict the spike receptor-binding domain (RBD) expression of SARSCoV-2 Omicron XBB.1.5 variants.

protein level regression

The dataset is from Deep mutational scans of XBB.1.5 and BQ.1.1 reveal ongoing epistatic drift during SARSCoV-2 evolution. Label means the delta level of RBD expression (log-mean fluorescence intensity) compre to wildtype, ranging from minus infinity to positive infinity. Zero means wildtype expression, lager means higher expression and smaller means lower expression.

Amino acid sequence

0.68 Spearman's ρ

lora_dropout: 0.0

lora_alpha: 16

target_modules: ["query", "key", "value", "intermediate.dense", "output.dense"]

modules_to_save: ["classifier"]

class: AdamW

betas: (0.9, 0.98)

weight_decay: 0.01

learning rate: 5e-4

epoch: 100

batch size: 200

precision: 16-mixed