Please use this identifier to cite or link to this item:
Publisher DOI: 10.3390/e24070972
Title: Information bottleneck signal processing and learning to maximize relevant information for communication receivers
Language: English
Authors: Lewandowsky, Jan 
Bauch, Gerhard 
Stark, Maximilian  
Keywords: information bottleneck; mutual information; machine learning
Issue Date: 14-Jul-2022
Publisher: Multidisciplinary Digital Publishing Institute
Source: Entropy 24 (7): 972 (2022)
Abstract (english): 
Digital communication receivers extract information about the transmitted data from the received signal in subsequent processing steps, such as synchronization, demodulation and channel decoding. Technically, the receiver-side signal processing for conducting these tasks is complex and hence causes bottleneck situations in terms of power, delay and chip area. Typically, many bits per sample are required to represent and process the received signal in the digital receiver hardware accurately. In addition, demanding arithmetical operations are required in the signal processing algorithms. A popular recent trend is designing entire receiver chains or some of their crucial building blocks from an information theoretical perspective. Signal processing blocks with very simple mathematical operations can be designed to directly maximize the relevant information that flows through them. At the same time, a strong quantization reduces the number of bits processed in the receiver to further lower the complexity. The described system design approach follows the principle of the information bottleneck method. Different authors proposed various ideas to design and implement mutual information-maximizing signal processing units. The first important aim of this article is to explain the fundamental similarities between the information bottleneck method and the functionalities of communication receivers. Based on that, we present and investigate new results on an entire receiver chain that is designed following the information bottleneck design principle. Afterwards, we give an overview of different techniques following the information bottleneck design paradigm from the literature, mainly dealing with channel decoding applications. We analyze the similarities of the different approaches for information bottleneck signal processing. This comparison leads to a general view on information bottleneck signal processing which goes back to the learning of parameters of trainable functions that maximize the relevant mutual information under compression.
DOI: 10.15480/882.4507
ISSN: 1099-4300
Journal: Entropy 
Other Identifiers: doi: 10.3390/e24070972
Institute: Nachrichtentechnik E-8 
Document Type: Article
More Funding information: This research received no external funding.
License: CC BY 4.0 (Attribution) CC BY 4.0 (Attribution)
Appears in Collections:Publications with fulltext

Files in This Item:
File Description SizeFormat
entropy-24-00972.pdf598,47 kBAdobe PDFView/Open
Show full item record

Page view(s)

checked on Mar 31, 2023


checked on Mar 31, 2023

Google ScholarTM


Note about this record

Cite this record


This item is licensed under a Creative Commons License Creative Commons