This page documents the reference implementation used in the following paper on online training of vanilla RNNs using Real-Time Recurrent Learning (RTRL) for medical time-series forecasting and 3D image recontruction.
We provide an implementation of the pyramidal iterative Lucas–Kanade optical flow algorithm for 3D image sequences, which we use to estimate motion in artificially extended 4D chest imaging acquisitions.
We forecast the position of three internal points near the lung tumor using RTRL, and use a simple linear correspondence model to recover the future dense deformation field within the selected ROI.
Nadaraya–Watson non-linear regression is used to warp the initial 3D reference frame according to the predicted motion field.
Although grid search on the validation set was resource intensive, inference time remained acceptable, and the tumor position in the predicted images was qualitatively consistent with the ground truth.
Overall, this work addresses respiratory motion forecasting for treatment-system latency compensation in radiotherapy, with a focus on online learning for continuous adaptation to unsteady breathing dynamic during radiation delivery.
1@article{pohl2021prediction,
2 title={Prediction of the motion of chest internal points using a recurrent neural network trained with real-time recurrent learning for latency compensation in lung cancer radiotherapy},
3 author={Pohl, Michel and Uesaka, Mitsuru and Demachi, Kazuyuki and Chhatkuli, Ritu Bhusal},
4 journal={Computerized Medical Imaging and Graphics},
5 volume={91},
6 pages={101941},
7 year={2021},
8 publisher={Elsevier}
9}
