Model Card for Model-Demo-ESMC-300M
Base model
[EvolutionaryScale/esmc-300m-2024-12]
Task description
This is a classification task and use the ESMC_300M model
Label meaning
Binary label represented by 1 for the binding pair and 0 for the non-binding pair.
Task type
Protein-level Classification
Model input type
AA Sequence
LoRA config
- r: 8
- lora_dropout: 0.0
- lora_alpha: 16
- target_modules: ['layernorm_qkv.1', 'out_proj', 'ffn.1', 'ffn.3']
- modules_to_save: ['classifier']
Training config
- optimizer:
- class: AdamW
- betas: (0.9, 0.98)
- weight_decay: 0.01
- learning rate: 0.0001
- epoch: 5
- batch size: 64
- precision: 16-mixed
