Now showing1 - 9 of 9
  • Some of the metrics are blocked by your 
    Item type:Publication,
    Deep denoising of volumetric OCT images for in vivo motion detection
    Optical Coherence Tomography (OCT) is an imaging modality with high temporal and spatial resolution. There are different applications, e.g. in ophthalmology, dermatology, cardiology and recently OCT image based motion compensation has been considered. However, OCT suffers from speckle noise which affects image quality and subsequent interpretation. We propose denoising based on unsupervised 3D convolutional Autoencoder (AE) and systematically evaluate the model on in vivo and post mortem datasets. Moreover, we study motion detection as a subsequent task and to investigate the effects of AE based denoising. Our results demonstrate that speckle noise in the OCT images can lead to substantial outliers. Denoising based on AEs is effective in reducing the outliers and results in improved motion detection. Furthermore, the proposed AE processes OCT volumes in 0.5 ms, making it suitable for real-time applications. Finally, the results illustrate that the AE can effectively improve motion detection performance on in vivo data, despite being trained on different data. In conclusion, our AE model presents a simple and unsupervised deep learning approach to obtain fast denoising adapted to OCT imaging. For motion detection, denoising can be crucial to avoid artifacts due to outliers.Clinical relevance: This work provides an efficient denoising Autoencoder for fast data processing that can be applied in various clinical scenarios to improve noisy 3D Optical Coherence Tomography images.
    Publicationtype: Conference Paper
      7
  • Some of the metrics are blocked by your 
    Item type:Publication,
    Deep Learning for High Speed Optical Coherence Elastography with a Fiber Scanning Endoscope
    Tissue stiffness is related to soft tissue pathologies and can be assessed through palpation or via clinical imaging systems, e.g., ultrasound or magnetic resonance imaging. Typically, the image based approaches are not suitable during interventions, particularly for minimally invasive surgery. To this end, we present a miniaturized fiber scanning endoscope for fast and localized elastography. Moreover, we propose a deep learning based signal processing pipeline to account for the intricate data and the need for real-time estimates. Our elasticity estimation approach is based on imaging complex and diffuse wave fields that encompass multiple wave frequencies and propagate in various directions. We optimize the probe design to enable different scan patterns. To maximize temporal sampling while maintaining three-dimensional information we define a scan pattern in a conical shape with a temporal frequency of 5.05 kHz. To efficiently process the image sequences of complex wave fields we consider a spatio-temporal deep learning network. We train the network in an end-to-end fashion on measurements from phantoms representing multiple elasticities. The network is used to obtain localized and robust elasticity estimates, allowing to create elasticity maps in real-time. For 2D scanning, our approach results in a mean absolute error of 6.31 ± 5.76 kPa compared to 11.33 ± 12.78 kPa for conventional phase tracking. For scanning without estimating the wave direction, the novel 3D method reduces the error to 4.48 ± 3.63 kPa compared to 19.75 ± 21.82 kPa for the conventional 2D method. Finally, we demonstrate feasibility of elasticity estimates in ex-vivo porcine tissue.
    Publicationtype: Journal Article
      22
  • Some of the metrics are blocked by your 
    Item type:Publication, Access status: with files ,
    Needle insertion planning for obstacle avoidance in robotic biopsy
    Understanding the underlying pathology in different tissues and organs is crucial when fighting pandemics like COVID-19. During conventional autopsy, large tissue sample sets of multiple organs can be collected from cadavers. However, direct contact with an infectious corpse is associated with the risk of disease transmission and relatives of the deceased might object to a conventional autopsy. To overcome these drawbacks, we consider minimally invasive autopsies with robotic needle placement as a practical alternative. One challenge in needle based biopsies is avoidance of dense obstacles, including bones or embedded medical devices such as pacemakers. We demonstrate an approach for automated planning and visualising suitable needle insertion points based on computed tomography (CT) scans. Needle paths are modeled by a line between insertion and target point and needle insertion path occlusion from obstacles is determined by using central projections from the biopsy target to the surface of the skin. We project the maximum and minimum CT attenuation, insertion depth, and standard deviation of CT attenuation along the needle path and create two-dimensional intensity-maps projected on the skin. A cost function considering these metrics is introduced and minimized to find an optimal biopsy needle path. Furthermore, we disregard insertion points without sufficient room for needle placement. For visualisation, we display the color-coded cost function so that suitable points for needle insertion become visible. We evaluate our system on 10 post mortem CTs with six biopsy targets in abdomen and thorax annotated by medical experts. For all patients and targets an optimal insertion path is found. The mean distance to the target ranges from (49.9 ± 12.9)mm for the spleen to (90.1 ± 25.8)mm for the pancreas.
    Publicationtype: Journal Article
    Scopus© Citations 3  56  64
  • Some of the metrics are blocked by your 
    Item type:Publication, Access status: with files ,
    Collaborative robot assisted smart needle placement
    Needles are key tools to realize minimally invasive interventions. Physicians commonly rely on subjectively perceived insertion forces at the distal end of the needle when advancing the needle tip to the desired target. However, detecting tissue transitions at the distal end of the needle is difficult since the sensed forces are dominated by shaft forces. Disentangling insertion forces has the potential to substantially improve needle placement accuracy.We propose a collaborative system for robotic needle insertion, relaying haptic information sensed directly at the needle tip to the physician by haptic feedback through a light weight robot. We integrate optical fibers into medical needles and use optical coherence tomography to image a moving surface at the tip of the needle. Using a convolutional neural network, we estimate forces acting on the needle tip from the optical coherence tomography data. We feed back forces estimated at the needle tip for real time haptic feedback and robot control. When inserting the needle at constant velocity, the force change estimated at the tip when penetrating tissue layers is up to 94% between deep tissue layers compared to the force change at the needle handle of 2.36 %. Collaborative needle insertion results in more sensible force change at tissue transitions with haptic feedback from the tip (49.79 ± 25.51)% compared to the conventional shaft feedback (15.17 ± 15.92) %. Tissue transitions are more prominent when utilizing forces estimated at the needle tip compared to the forces at the needle shaft, indicating that a more informed advancement of the needle is possible with our system.
    Publicationtype: Journal Article
    Scopus© Citations 1  108  251
  • Some of the metrics are blocked by your 
    Item type:Publication, Access status: with files ,
    A novel optical needle probe for deep learning-based tissue elasticity characterization
    The distinction between malignant and benign tumors is essential to the treatment of cancer. The tissue's elasticity can be used as an indicator for the required tissue characterization. Optical coherence elastography (OCE) probes have been proposed for needle insertions but have so far lacked the necessary load sensing capabilities. We present a novel OCE needle probe that provides simultaneous optical coherence tomography (OCT) imaging and load sensing at the needle tip. We demonstrate the application of the needle probe in indentation experiments on gelatin phantoms with varying gelatin concentrations. We further implement two deep learning methods for the end-toend sample characterization from the acquired OCT data. We report the estimation of gelatin sample weight ratios [wt%] in unseen samples with a mean error of 1.21 ± 0.91 wt%. Both evaluated deep learning models successfully provide sample characterization with different advantages regarding the accuracy and inference time.
    Publicationtype: Journal Article
    Scopus© Citations 3  93  188
  • Some of the metrics are blocked by your 
    Item type:Publication, Access status: with files ,
    Parameter identification for ultrasound shear wave elastography simulation
    Elasticity of soft tissue is a valuable information to physicians in treatment and diagnosis of diseases. The elastic properties of tissue can be estimated with ultrasound (US) shear wave imaging (SWEI). In US-SWEI, a force push is applied inside the tissue and the resulting shear wave is detected by high-frequency imaging. The properties of the wave such as the shear wave velocity can be mapped to tissue elasticity. Commonly, wave features are extracted by tracking the peak of the shear wave, estimating the phase velocity or with machine learning methods. To tune and test these methods, often simulation data is employed since material properties and excitation can be accurately controlled. Subsequent validation on real US-SWEI data is in many cases performed on tissue phantoms such as gelatine. Clearly, validation performance of these procedures is dependent on the accuracy of the simulated tissue phantom and a thorough comparison of simulation and experimental data is needed. In this work, we estimate wave parameters from 400 US-SWEI data sets acquired in various homogeneous gelatine phantoms. We tune a linear material model to these parameters. We report an absolute percentage error for the shear wave velocity between simulation and phantom experiment of <2.5%. We validate our material model on unknown gelatine concentrations and estimate the shear wave velocity with an error <3.4% for in-range concentrations indicating that our material model is in good agreement with US-SWEI measurements.
    Publicationtype: Journal Article
    Scopus© Citations 1  109  296
  • Some of the metrics are blocked by your 
    Item type:Publication, Access status: with files ,
    Needle placement accuracy in CT-guided robotic post mortem biopsy
    © 2020 Martin Gromniak et al., published by De Gruyter, Berlin/Boston 2020. Forensic autopsies include a thorough examination of the corpse to detect the source or alleged manner of death as well as to estimate the time since death. However, a full autopsy may be not feasible due to limited time, cost or ethical objections by relatives. Hence, we propose an automated minimal invasive needle biopsy system with a robotic arm, which does not require any online calibrations during a procedure. The proposed system can be easily integrated into the workflow of a forensic biopsy since the robot can be flexibly positioned relative to the corpse. With our proposed system, we performed needle insertions into wax phantoms and livers of two corpses and achieved an accuracy of 4.34 ± 1.27 mm and 10.81 ± 4.44 mm respectively.
    Publicationtype: Journal Article
    Scopus© Citations 3  254  213
  • Some of the metrics are blocked by your 
    Item type:Publication, Access status: with files ,
    Force estimation from 4D OCT data in a human tumor xenograft mouse model
    Minimally invasive robotic surgery offer benefits such as reduced physical trauma, faster recovery and lesser pain for the patient. For these procedures, visual and haptic feedback to the surgeon is crucial when operating surgical tools without line-of-sight with a robot. External force sensors are biased by friction at the tool shaft and thereby cannot estimate forces between tool tip and tissue. As an alternative, vision-based force estimation was proposed. Here, interaction forces are directly learned from deformation observed by an external imaging system. Recently, an approach based on optical coherence tomography and deep learning has shown promising results. However, most experiments are performed on ex-vivo tissue. In this work, we demonstrate that models trained on dead tissue do not perform well in in vivo data. We performed multiple experiments on a human tumor xenograft mouse model, both on in vivo, perfused tissue and dead tissue. We compared two deep learning models in different training scenarios. Training on perfused, in vivo data improved model performance by 24% for in vivo force estimation.
    Publicationtype: Journal Article
    Scopus© Citations 1  196  191
  • Some of the metrics are blocked by your 
    Item type:Publication, Access status: with files ,
    Towards contactless optical coherence elastography with acoustic tissue excitation
    Elastography presents an interesting approach to complement image data with mechanical tissue properties. Typically, the tissue is excited by direct contact to a probe. We study contactless elastography based on optical coherence tomography (OCT) and dynamic acoustic tissue excitation with airborne sound. We illustrate the principle and an implementation using sound waves of 135 Hz to excite the tissue. The displacement is measured and results of several tests indicate the feasibility to obtain a qualitative measure of the mechanical tissue properties. The approach is interesting for optical palpation, e.g., to enhance navigation and tissue characterization in minimally invasive and robot-assisted surgery.
    Publicationtype: Journal Article
      96  154