Please use this identifier to cite or link to this item:
Publisher DOI: 10.1007/s11548-020-02203-1
Title: SpeckleGAN: a generative adversarial network with an adaptive speckle layer to augment limited training data for ultrasound image processing
Language: English
Authors: Bargsten, Lennart 
Schlaefer, Alexander 
Keywords: Deep learning;Image segmentation;Small datasets;Speckle noise;Synthetic image generation;Theory-guided neural networks
Issue Date: 18-Jun-2020
Publisher: Springer
Source: International Journal of Computer Assisted Radiology and Surgery 9 (15): 1427-1436 (2020-09-01)
Journal or Series Name: International journal of computer assisted radiology and surgery 
Abstract (english): Purpose: In the field of medical image analysis, deep learning methods gained huge attention over the last years. This can be explained by their often improved performance compared to classic explicit algorithms. In order to work well, they need large amounts of annotated data for supervised learning, but these are often not available in the case of medical image data. One way to overcome this limitation is to generate synthetic training data, e.g., by performing simulations to artificially augment the dataset. However, simulations require domain knowledge and are limited by the complexity of the underlying physical model. Another method to perform data augmentation is the generation of images by means of neural networks. Methods: We developed a new algorithm for generation of synthetic medical images exhibiting speckle noise via generative adversarial networks (GANs). Key ingredient is a speckle layer, which can be incorporated into a neural network in order to add realistic and domain-dependent speckle. We call the resulting GAN architecture SpeckleGAN. Results: We compared our new approach to an equivalent GAN without speckle layer. SpeckleGAN was able to generate ultrasound images with very crisp speckle patterns in contrast to the baseline GAN, even for small datasets of 50 images. SpeckleGAN outperformed the baseline GAN by up to 165 % with respect to the Fréchet Inception distance. For artery layer and lumen segmentation, a performance improvement of up to 4 % was obtained for small datasets, when these were augmented with images by SpeckleGAN. Conclusion: SpeckleGAN facilitates the generation of realistic synthetic ultrasound images to augment small training sets for deep learning based image processing. Its application is not restricted to ultrasound images but could be used for every imaging methodology that produces images with speckle such as optical coherence tomography or radar.
DOI: 10.15480/882.2976
ISSN: 1861-6410
Institute: Medizintechnische Systeme E-1 
Type: (wissenschaftlicher) Artikel
Funded by: This work was partially funded by the European Regional Development Fund (ERDF), by the Hamburgische Investitions- und Förderbank (IFB) and by the Free and Hanseatic City of Hamburg.
License: CC BY 4.0 (Attribution) CC BY 4.0 (Attribution)
Appears in Collections:Publications with fulltext

Files in This Item:
File Description SizeFormat
Bargsten-Schlaefer2020_Article_SpeckleGANAGenerativeAdversari.pdfVerlags-PDF2,16 MBAdobe PDFThumbnail
Show full item record

Page view(s)

Last Week
Last month
checked on Oct 28, 2020


checked on Oct 28, 2020

Google ScholarTM


Note about this record


This item is licensed under a Creative Commons License Creative Commons