HawkEye: Training Video-Text LLMs for Grounding Text in Videos
This repo provides the checkpoint of HawkEye, and our implementation of VideoChat2.
videochat2-stage3-our_impl.pth is the chekepoint of our reproduce of VideoChat2. You can use it as an substitution of hawkeye.pth.
The difference between it and HawkEye is: not trained with data from InternVid-G.
The difference between it and the original implementation of VideoChat2 is: the visual encoder is frozen, and not trained with image data from VideoChat2-IT
For more details please refer to our paper and github.
