Banner Banner

Towards a Modular Data Management System Framework

Haralampos Gavriilidis
Lennart Behme
Sokratis Papadopoulos
Stefano Bortoli
Jorge-Arnulfo Quiané-Ruiz
Volker Markl

September 09, 2022

Today’s data management systems (DMSes) are implemented using monolithic architectures. This is explained by the fact that, historically, the DMS market was dominated by commercial solutions. However, with the advent of open source, lots of alternative DMSes and DMS components have emerged. Yet, they cannot be easily integrated because DMSes are still designed as monoliths. We propose PolyDMS, our vision towards composable DMSes. The core idea of PolyDMS is to split up and wrap individual components with standardized interfaces, such that a Component Orchestrator can flexibly construct DMSes out of them. Users can compose new DMSes by writing small programs in our System Definition Language. PolyDMS allows them to quickly instantiate new DMSes according to their needs while giving them the opportunity to reuse existing components. Our proof-of-concept implementation shows that composing multiple components into a new DMS can yield additional functionality and better performance.