WildDet3D in Your Pocket
Real-time 3D object detection on iPhone with AR overlay.
The app captures RGB frames and LiDAR depth via ARKit and streams them to a cloud-hosted WildDet3D inference endpoint. It supports multiple interaction modes: open-vocabulary text queries, 2D bounding box prompts for geometric detection, and real-time camera-based inference. Detected 3D boxes are rendered as AR overlays anchored to the physical scene using ARKit world tracking.
Note: The model currently runs on a remote server — the app sends frames to a cloud-hosted API and receives 3D detection results back. On-device inference is not yet supported.
License
