TUHH Open Research
Help
  • Log In
    New user? Click here to register.Have you forgotten your password?
  • English
  • Deutsch
  • Communities & Collections
  • Publications
  • Research Data
  • People
  • Institutions
  • Projects
  • Statistics
  1. Home
  2. TUHH
  3. Publication References
  4. Pathfinder: Fault tolerance for stream processing systems
 
Options

Pathfinder: Fault tolerance for stream processing systems

Publikationstyp
Conference Paper
Date Issued
2019-04
Sprache
English
Author(s)
Knasmüller, Bernhard  
Hochreiner, Christoph  
Schulte, Stefan  
TORE-URI
http://hdl.handle.net/11420/11902
Start Page
29
End Page
39
Article Number
8848250
Citation
5th IEEE International Conference on Big Data Service and Applications (BigDataService 2019)
Contribution to Conference
5th IEEE International Conference on Big Data Service and Applications (BigDataService 2019)  
Publisher DOI
10.1109/BigDataService.2019.00011
Scopus ID
2-s2.0-85073235247
Stream processing systems are able to integrate data from various sources, and to invoke self-hosted and external operators. In case of faults, such systems usually rely on the redundancy of single stream processing operators, while the relationship between the single operators is not taken into account. Hence, there is a lack of approaches towards fault-tolerant distributed stream processing which consider that stream processing applications are often composed of different operators. Within this paper, we present the Pathfinder framework which overcomes this shortcoming by enabling functional redundancy at the level of stream processing operator paths. During system runtime, Pathfinder reacts to operator failures in the main path by switching to a fault-free path with a similar functionality. To restore the main path once a failed operator has recovered, Pathfinder uses the circuit breaker pattern.
Subjects
Big data
Data streams
Fault tolerance
Stream processing
DDC Class
600: Technik
TUHH
Weiterführende Links
  • Contact
  • Send Feedback
  • Cookie settings
  • Privacy policy
  • Impress
DSpace Software

Built with DSpace-CRIS software - Extension maintained and optimized by 4Science
Design by effective webwork GmbH

  • Deutsche NationalbibliothekDeutsche Nationalbibliothek
  • ORCiD Member OrganizationORCiD Member Organization
  • DataCiteDataCite
  • Re3DataRe3Data
  • OpenDOAROpenDOAR
  • OpenAireOpenAire
  • BASE Bielefeld Academic Search EngineBASE Bielefeld Academic Search Engine
Feedback