You can deploy this model and start earning money today!

FanqiPu/
MonoDGP

2410.19590

Views

No views yet

This repository hosts the official implementation of MonoDGP: Monocular 3D Object Detection with Decoupled-Query and Geometry-Error Priors based on the excellent work MonoDETR. In this work, we propose a novel transformer-based monocular method called MonoDGP, which adopts geometry errors to correct the projection formula. We also introduce a 2D visual decoder for query initialization and a region segmentation head for feature enhancement.

Installation

Clone this project and create a conda environment:

bash
1git clone https://github.com/PuFanqi23/MonoDGP.git 2cd MonoDGP 3 4conda create -n monodgp python=3.8 5conda activate monodgp
Install pytorch and torchvision matching your CUDA version:

bash
1# For example, We adopt torch 1.9.0+cu111 2pip install torch==1.9.0+cu111 torchvision==0.10.0+cu111 torchaudio==0.9.0 -f https://download.pytorch.org/whl/torch_stable.html
Install requirements and compile the deformable attention:

bash
1pip install -r requirements.txt 2 3cd lib/models/monodgp/ops/ 4bash make.sh 5 6cd ../../../..
Download KITTI datasets and prepare the directory structure as:

bash
1│MonoDGP/ 2├──... 3│data/kitti/ 4├──ImageSets/ 5├──training/ 6│ ├──image_2 7│ ├──label_2 8│ ├──calib 9├──testing/ 10│ ├──image_2 11│ ├──calib

You can also change the data path at "dataset/root_dir" in configs/monodgp.yaml.

Get Started

Train

You can modify the settings of models and training in configs/monodgp.yaml and indicate the GPU in train.sh:

bash train.sh configs/monodgp.yaml > logs/monodgp.log

Test

The best checkpoint will be evaluated as default. You can change it at "tester/checkpoint" in configs/monodgp.yaml:

bash test.sh configs/monodgp.yaml

You can test the inference time on your own device:

python tools/test_runtime.py

Citation

If you find our work useful in your research, please consider giving us a star and citing:

latex

@article{pu2024monodgp,
  title={MonoDGP: Monocular 3D Object Detection with Decoupled-Query and Geometry-Error Priors},
  author={Pu, Fanqi and Wang, Yifan and Deng, Jiru and Yang, Wenming},
  journal={arXiv preprint arXiv:2410.19590},
  year={2024}
}

Acknowlegment

This repo benefits from the excellent work MonoDETR.

FanqiPu/MonoDGP