Regarding the data, first of all, you should download the MMfin.tsv and MMfin_CN.tsv files, as well as the relevant financial images. The folder structure is shown as follows:
├─ datasets
├─ images
├─ MMfin
...
├─ MMfin_CN
...
│ MMfin.tsv
│ MMfin_CN.tsv
The following is the process of inference and evaluation (Qwen2-VL-2B-Instruct as an example):
export LMUData="The path of the datasets"
python… See the full description on the dataset page:
https://huggingface.co/datasets/Feisu55/MME-Finance.
