[Paper] [Citing] [Project Page] [Github Repository]

CityPulse-DINOv2 is an urban structural change detection model finetuned based on the parameters of a Siamese DINOv2 (ViT-B/14) model. This model has been fine-tuned on the CityPulse (Huang et al. 2024) dataset. It achieves an accuracy of 88.85% in the urban building change detection task, which makes it suitable for fine-grained assessment of urban changes. The intention behind releasing this model is to provide the research community with more comprehensive and extensive resources, facilitate broader downstream research on urbans, and advance sustainable development goals.

Given the nature of the training data, the CityPulse model is best suited for detecting physical alterations in the built environment. The model accepts two 224x224 RGB images as input. For urban change detection tasks, the input images should be taken at roughly the same location but at different times. The output of the model is a value ranging from 0 to 1, which can be interpreted as the model's inference of the probability of changes occurring in the buildings depicted in the images.

The example Python code for inference using this model checkpoint is shown in the Github Repo.

Although has been tested on a dataset comprising over 12,700 image pairs, the model robustness remains unclear when faced with noisier images, more complex urban environments, and more diverse urban styles.

Our curated CityPulse dataset comprises 25,423 image pairs, including 4,465 images across five US cities, with a timespan exceeding 16 years.

Please refer to citypulse.yaml in the Github Repository for environment configuration.

The model is licensed under the MIT license.

If you found this model checkpoint useful, please consider citing: