Revisiting M3D is all you need
Solution Overview
This code is the 3rd place solution for the MICCAI 2024 AMOS-MM Challenge. It is based on the M3D model and utilizes the LLaMA-3.1-Instruct-7B.
Novelty
- We divided the body into three regions: chest, abdomen, and pelvis. This allowed us to focus more effectively on these areas and further improve performance through text prompt engineering.
- The introduction of LLaMA-3.1-8B-Instruct significantly boosted MRG and VQA performance.
- Additionally, the use of an error note strategy led to further improvements in the final results.
Acknowledgement:
We appreciate open source projects including: M3D, LLaVA, LLaMA.
