SPINE is a segmentation-guided multimodal framework for spinal MRI report generation using 3D vision-language models. The framework integrates T1-weighted MRI, T2-weighted MRI, and anatomical segmentation masks to enhance spatial and contextual understanding of spinal structures. By incorporating anatomical priors through segmentation, SPINE improves the generation of clinically meaningful radiology reports.

Experiments were conducted on two public spinal MRI datasets comprising 515 axial and 190 sagittal cases. Three input configurations were evaluated, with the combination of T1, T2, and segmentation achieving the best performance on the axial dataset. For sagittal MRI, structured gradings were transformed into narrative reports using large language models, demonstrating that structured supervision improves report consistency and semantic accuracy.

This work builds upon:

We thank the original authors for making their code and pretrained models publicly available.

If you use this work in your research, please cite: