4D spatio-temporal convolutional networks for object position estimation in OCT volumes

Tracking and localizing objects is a central problem in computer-assisted surgery. Optical coherence tomography (OCT) can be employed as an optical tracking system, due to its high spatial and temporal resolution. Recently, 3D convolutional neural networks (CNNs) have shown promising performance for pose estimation of a marker object using single volumetric OCT images. While this approach relied on spatial information only, OCT allows for a temporal stream of OCT image volumes capturing the motion of an object at high volumes rates. In this work, we systematically extend 3D CNNs to 4D spatio-temporal CNNs to evaluate the impact of additional temporal information for marker object tracking. Across various architectures, our results demonstrate that using a stream of OCT volumes and employing 4D spatio-temporal convolutions leads to a 30% lower mean absolute error compared to single volume processing with 3D CNNs.

Subjects

convolutional neural networks

optical coherence tomography

position estimation

spatio-temporal data

DDC Class

004: Informatik

600: Technik

610: Medizin

Publication version

publishedVersion

Lizenz

https://creativecommons.org/licenses/by/4.0/

Name

[23645504 - Current Directions in Biomedical Engineering] 4D spatio-temporal convolutional networks for object position estimation in OCT volumes.pdf

Size

486.46 KB

Format

Adobe PDF

Options

4D spatio-temporal convolutional networks for object position estimation in OCT volumes