Model	VCL	NF	Type	Best Epoch
SG-SlotSSM (Sparse Gated)	64	4	frozen	50
SG-SlotSSM (Sparse Gated)	64	4	finetuned	30
SG-SlotSSM (Sparse Gated)	28	4	frozen	100
SG-SlotSSM (Sparse Gated)	28	4	finetuned	50
SG-SlotSSM (Sparse Gated)	16	4	finetuned	100
SG-SlotSSM (Sparse Gated)	8	4	frozen	100
SG-SlotSSM (Sparse Gated)	8	4	finetuned	100
SlotSSM (Dense)	64	4	frozen	50
SlotSSM (Dense)	64	4	finetuned	30
SlotSSM (Dense)	28	4	frozen	100
SlotSSM (Dense)	28	4	finetuned	60
SlotSSM (Dense)	16	4	finetuned	100
SlotSSM (Dense)	8	4	frozen	90
SlotSSM (Dense)	8	4	finetuned	100
Mamba	64	4	frozen	40
Mamba	64	4	finetuned	20
Mamba	28	4	frozen	60
Mamba	28	4	finetuned	30
Mamba	16	4	finetuned	100
Mamba	8	4	frozen	90
Mamba	8	4	finetuned	100
LSTM	64	4	frozen	20
LSTM	64	4	finetuned	20
LSTM	28	4	frozen	50
LSTM	28	4	finetuned	40
LSTM	16	4	finetuned	80
LSTM	8	4	frozen	100
LSTM	8	4	finetuned	80
Encoder Only	16	12	finetuned	150
Encoder Only	12	8	finetuned	150
Encoder Only	8	4	finetuned	150

Usage

Download a checkpoint and use it with the VAD-JEPA repo:

python main.py --config cfgs/vjepa_sparse_slotssm.yaml --phase test --epoch 50

Each folder contains checkpoints/model-{epoch}.pt.

Anshler/vad-jepa