Publisher DOI: 10.1007/978-3-030-59716-0_66
Title: Spectral-spatial Recurrent-Convolutional Networks for In-Vivo Hyperspectral Tumor Type Classification
Language: English
Authors: Bengs, Marcel 
Gessert, Nils Thorben 
Laffers, Wiebke 
Eggert, Dennis 
Westermann, Stephan 
Mueller, Nina A. 
Gerstner, Andreas O. H. 
Betz, Christian Stephan 
Schlaefer, Alexander 
Keywords: Head and neck cancer;Hyperspectral imaging;Spatio-spectral deep learning
Issue Date: Oct-2020
Publisher: Springer
Source: 23rd International Conference on Medical Image Computing and Computer-Assisted Intervention: 690-699 (MICCAI 2020)
Part of Series: Lecture notes in computer science 
Volume number: 12263 LNCS
Abstract (english): 
Early detection of cancerous tissue is crucial for long-term patient survival. In the head and neck region, a typical diagnostic procedure is an endoscopic intervention where a medical expert manually assesses tissue using RGB camera images. While healthy and tumor regions are generally easier to distinguish, differentiating benign and malignant tumors is very challenging. This requires an invasive biopsy, followed by histological evaluation for diagnosis. Also, during tumor resection, tumor margins need to be verified by histological analysis. To avoid unnecessary tissue resection, a non-invasive, image-based diagnostic tool would be very valuable. Recently, hyperspectral imaging paired with deep learning has been proposed for this task, demonstrating promising results on ex-vivo specimens. In this work, we demonstrate the feasibility of in-vivo tumor type classification using hyperspectral imaging and deep learning. We analyze the value of using multiple hyperspectral bands compared to conventional RGB images and we study several machine learning models’ ability to make use of the additional spectral information. Based on our insights, we address spectral and spatial processing using recurrent-convolutional models for effective spectral aggregating and spatial feature learning. Our best model achieves an AUC of 76.3%, significantly outperforming previous conventional and deep learning methods.
Conference: 23rd International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI 2020) 
ISBN: 978-3-030-59716-0
ISSN: 0302-9743
Institute: Medizintechnische Systeme E-1 
Document Type: Chapter/Article (Proceedings)
Project: Verbesserte Diagnostik von Tumoren des oberen Luft-Speiseweg durch Kombination von hyperspektraler Bildgebung mit Methoden der künstlichen Intellligenz 
Appears in Collections:Publications without fulltext

Show full item record

Page view(s)

Last Week
Last month
checked on Nov 26, 2021


Last Week
Last month
checked on Nov 25, 2021

Google ScholarTM


Add Files to Item

Note about this record

Cite this record


Items in TORE are protected by copyright, with all rights reserved, unless otherwise indicated.