File	Description
`adapter_model.safetensors`	LoRA weights (rank 8, Q&V of the last 6 transformer blocks) + classification head (768→512 proj, LayerNorm, 13 logits)
`adapter_config.json`	LoRA hyperparameters (r=8, alpha=16, dropout=0.05)
`calibrated_thresholds.json`	Per-class decision thresholds (Youden's J on validation)

Important: not a drop-in PEFT adapter

This adapter is part of a hand-reconstructed model graph, not an auto-loadable PEFT module. PeftModel.from_pretrained(...) will not work out of the box: the LoRA lives inside the fused qkv projection of a timm-wrapped ViT (visual.trunk), which has no stock PEFT target. You must rebuild the exact architecture before loading weights:

Load the base model via open_clip.create_model_and_transforms('microsoft/BiomedCLIP-PubMedBERT_256-vit_base_patch16_224').
Freeze the vision tower (clip_model.visual).
Inject LoRA into Q and V only of the last 6 blocks (blocks[6..11]). timm backend: wrap blocks[idx].attn.qkv with a module that adds low-rank adapters to the Q and V slices of the fused qkv output (K slice unchanged). LoRA math: output = frozen_linear(x) + (alpha/r) * dropout(x) @ A^T @ B^T.
Append the classification head: nn.Sequential(LayerNorm(512), Dropout(0.1), Linear(512, 13)) over the encoder output (head input here is 512 — the output of encoder.head.proj).
load_state_dict the tensors in adapter_model.safetensors onto the reconstructed state dict.

Preprocessing

Resize to 224×224, convert to RGB.
Normalize with (0.4815, 0.4578, 0.4082) / (0.2686, 0.2613, 0.2758) (BiomedCLIP's own preprocessing stats).
No augmentation at inference. model.eval(), torch.no_grad().

Output / labels

13 raw logits, one per class, in this exact order:

['enlarged cardiomediastinum', 'cardiomegaly', 'atelectasis', 'consolidation',
 'lung edema', 'fracture', 'lung lesion', 'pleural effusion', 'pneumonia',
 'pneumothorax', 'support device', 'lung opacity', 'pleural other']

Multi-label: apply a per-class sigmoid (no softmax).

For binary predictions, threshold each class's sigmoid probability using calibrated_thresholds.json (per-class, not a flat 0.5). If you only need a score, report raw sigmoid outputs.

tsvd/biomedclip-cxr-lora

BiomedCLIP-CXR LoRA

Files

Important: not a drop-in PEFT adapter

Preprocessing

Output / labels

tsvd/
biomedclip-cxr-lora