We present Bidirectional Cross-Attention Fusion (BCAF), which aligns high-resolution RGB with low-resolution HSI at their native grids via localized, bidirectional cross-attention, avoiding spatial pre-upsampling or early spectral collapse. BCAF uses two independent backbones: a standard Swin Transformer for RGB and an HSI-adapted Swin backbone that preserves spectral structure through 3D tokenization with spectral self-attention.
Please refer to the detailed instructions and example notebooks (Preprocess, Evaluate, and Training) available on the
official GitHub repository.
1@article{funk2026bcaf,
2 title={Bidirectional Cross-Attention Fusion of High-Res RGB and Low-Res HSI
3 for Multimodal Automated Waste Sorting},
4 author={Jonas V. Funk and Lukas Roming and Andreas Michel and Paul B{\"{a}}cker
5 and Georg Maier and Thomas L{\"{a}}ngle and Markus Klute},
6 year={2026},
7 eprint={2603.13941},
8 archivePrefix={arXiv},
9 primaryClass={cs.CV},
10 url={https://arxiv.org/abs/2603.13941}
11}
