Theta architecture: Preserving the quality of analytics in data-driven systems

First published in
Communications in Computer and Information Science  
Number in series
767
Start Page
186
End Page
198
Citation
Communications in Computer and Information Science 767: 186-198 (2017)
Contribution to Conference
21st European Conference on Advances in Databases and Information Systems, ADBIS 2017  
Publisher DOI
10.1007/978-3-319-67162-8_19
Scopus ID
2-s2.0-85029790815
Publisher
Springer
With the recent advances in Big Data storage and processing, there is a real potential of data-driven software systems, i.e., systems that employ analysis of large amounts of data to inform their runtime decisions. However, for these decisions to be trustworthy and dependable, one needs to deal with the well-known challenges on the data analysis domain: Data scarcity, low-quality of data available for analysis, low veracity of data and subsequent analysis results, data privacy constraints that hinder the analysis. A promising solution is to introduce flexibility in the data analytics part of the system enabling optimization at runtime of the algorithms and data streams based on the combination of veracity, privacy and scarcity in order to preserve the target level of quality of the data-driven decisions. In this paper, we investigate this solution by providing an adaptive reference architecture and illustrate its applicability with an example from the traffic management domain.
Subjects
Big Data
Data veracity
Reference architecture
DDC Class
004: Informatik