DDNM X-ray512 CT Projection Prior
Hugging Face model repository:
Hyun-Jic/ddnm-xray512-ct-projection-prior
This repository is intended to host the diffusion checkpoint used by the DDNM projection super-resolution stage of:
Zero-shot CT Super-Resolution using Diffusion-based 2D Projection Priors and Signed 3D Gaussians.
Model Description
This checkpoint is a 512x512 2D diffusion prior trained on chest X-ray domain images and used as the image prior inside DDNM for CT projection super-resolution. It is not a standalone CT volume reconstruction model. In the full pipeline, a low-resolution CT volume is first converted into 2D projection images; DDNM then uses this diffusion prior to enhance each projection; the enhanced projections are subsequently used by the 3D reconstruction stage.
Intended Use
- 2D CT projection super-resolution through DDNM.
- Zero-shot 3D CT super-resolution pipelines where projection-domain priors are used before volume reconstruction.
- Research use and reproduction of the projection-prior stage.
Training Data
The diffusion prior was trained on chest X-ray domain images from:
The model is used as a natural/medical X-ray image prior for projection-domain restoration. It was not trained directly on the target CT volumes used for downstream evaluation.
Architecture and Sampling Settings
The checkpoint follows an improved-diffusion / guided-diffusion style UNet configuration:
1image_size: 512
2in_channels: 3
3out_channels: 3
4num_channels: 256
5num_res_blocks: 2
6attention_resolutions: "32,16,8"
7num_heads: 4
8num_head_channels: 64
9dropout: 0.0
10learn_sigma: false
11use_scale_shift_norm: true
12use_fp16: true
13resblock_updown: true
14beta_schedule: linear
15beta_start: 0.0001
16beta_end: 0.02
17num_diffusion_timesteps: 1000
DDNM projection SR settings used in the release wrapper:
| Scale | degradation | eta | sigma_y | sampling steps |
|---|
| 4x | sr_averagepooling | 0.990 | 0.0010 | 50 |
| 8x | sr_averagepooling | 0.990 | 0.0025 | 50 |
Files
Upload the DDNM/SIDE checkpoint as:
The GitHub wrapper expects this file by default.
Usage
1pip install huggingface_hub
2
3python ddnm_inference/run_ddnm_projection_sr.py \
4 --hf-model-repo Hyun-Jic/ddnm-xray512-ct-projection-prior \
5 --hf-model-file ema_0.9999_620000.pt \
6 --ddnm-root /path/to/DDNM \
7 --input-npy examples/mela_0050/mela_0050_projection_4x_128x128.npy \
8 --gt-pickle /path/to/MELA_GT_512_rmbed/mela_0050_rmbed.pickle \
9 --case-id mela_0050 \
10 --scale 4
Limitations
- The model is a 2D projection prior, not a complete 3D CT reconstructor.
- Output quality depends on the DDNM degradation operator, projection normalization, and downstream reconstruction.
- Clinical use is not intended without additional validation.
Notes
The checkpoint is large and should be stored on Hugging Face rather than in the GitHub repository.