Banner Banner

Fast datalog evaluation for batch and stream graph processing

Muhammad Imran
Gábor E. Gévay
Jorge-Anulfo Quiané-Ruiz
Volker Markl

January 20, 2022

Implementing complex algorithms for big data, artificial intelligence, and graph processing requires enormous effort. Succinct, declarative programs to solve complex problems that can be efficiently executed for batching and streaming data are in demand. This paper presents Nexus, a distributed Datalog evaluation system. It evaluates Datalog programs using the semi-naive algorithm for batch and streaming data using incremental and asynchronous iteration. Furthermore, we evaluate Datalog programs with aggregates to determine the advantages of implementing the semi-naive algorithm using incremental iteration on its performance. Our experimental results show that Nexus significantly outperforms acyclic dataflow-based systems.

DOI: doi.org/10.1007/s11280-021-00960-w