Views
No views yet
This is the production dtSFM (v3): a full-scale cross-attention encoder paired with a cross-attentive autoregressive decoder. The smaller encoder-only prototype from the Vibe Coding SFMs paper lives separately atSFM-BIIE-ETHZ/dtSFM_VC-SFM.
| Component | Model |
|---|---|
| Drug encoder | MoLFormer-XL (frozen, SMILES → 768-d) |
| Protein encoder | ESM-2-650M (frozen, → 1,280-d per residue) |
| Cross-attention encoder | trainable, 2 layers · 8 heads · d=512 · 14.4 M params · 4 heads |
| Decoder | cross-attentive autoregressive SMILES generator (~28 M params) |
| Training data | PDBbind v2020 + SAIR (714,747 pairs · 522,776 drugs · 22,964 proteins) |
| Split | whole MMseqs2 protein clusters held out at 80% identity; zero pair/protein/cluster leakage |
| File | Description |
|---|---|
encoder_b3_epoch010.pt | locked production encoder (B-3, 4 heads) |
decoder_v02_step50000.pt | cross-attentive generative decoder (checkpoint @ 50k steps) |
1from huggingface_hub import hf_hub_download
2import torch, torch.nn.functional as F
3from calm.encoder.model_v3 import CALMEncoderV3
4from calm.decoder.model_dtsfm_v3 import CALMDecoderV3
5
6# --- retrieval / scoring (drug ↔ target) ---
7enc = CALMEncoderV3.from_pretrained(
8 hf_hub_download("SFM-BIIE-ETHZ/dtSFM-v3", "encoder_b3_epoch010.pt")).eval()
9drug = enc.encode_drug("CC(=O)Oc1ccccc1C(=O)O") # aspirin
10target = enc.encode_protein("MTEYKLVVVGAGGVGKSALTIQLIQ...")
11score = F.cosine_similarity(drug, target, dim=-1)
12
13# --- generation (target → novel molecules) ---
14dec = CALMDecoderV3.from_pretrained(
15 hf_hub_download("SFM-BIIE-ETHZ/dtSFM-v3", "decoder_v02_step50000.pt")).eval()
16smiles = dec.generate(target_sequence="MTEYKLVVVGAGG...", n=100, temperature=0.8)conda env create -f environment.yml).1@article{reddy2026dtsfm,
2 title = {A drug–target specificity foundation model for off-target prediction, repurposing, and generative design},
3 author = {Reddy, Sai T.},
4 journal = {bioRxiv},
5 year = {2026},
6 doi = {10.64898/2026.06.08.730844}
7}LICENSE.md).
Free for research use — academic, non-profit, government, and industry research. The specific
molecules disclosed in the accompanying preprints are dedicated to the public. Commercial-use
and patent-licensing terms are deferred and being arranged with ETH Zürich / BIIE; the SFM
architectures and training methods are the subject of pending patent applications.
For commercial enquiries: sai.reddy@ethz.ch