Apache Wayang in Action: Enabling Data Systems Integration via a Unified Data Analytics Framework.
- Kaustubh Beedkar,
- Aurélien Bertrand,
- Haralampos Gavriilidis,
- Augusto José Fonseca,
- ,
- Mingxi Liu
- Indian Institute of Technology Delhi,
- Technical University of Berlin,
- National Laboratory of Scientific Computation,
- ,
- ,
- East China Normal University
Research Output:
Conference Article in Proceeding or Book/Report chapter
Article in proceedings
Peer-reviewOpen access
Publication Information
Output type
Research Output:
Conference Article in Proceeding or Book/Report chapter
Article in proceedings
Peer-reviewOriginal language
EnglishPages from-to (Number of pages)
Pages 35-38 (4 pages)Publication milestones
- Published - 22/06/2025
Publication status
Published - 22/06/2025
Place of publication
New York, USA Publisher
Association for Computing Machinery, United StatesISBN (Print)
9798400715648ISBN (Electronic)
9798400715648Publication IDs
- Scopus: 105010210649
Host publication title
Companion of the 2025 International Conference on Management of DataAbstract
Apache Wayang is an open-source framework, which provides a systematic and efficient solution for unifying data analytics over disparate data sources and via integrating multiple heterogeneous data systems. It achieves that by decoupling applications from the underlying systems. In addition, it provides an optimizer so that users do not have to specify the platforms on which their pipeline should run but the optimizer can determine the best way given a cost metric. In this demonstration, we showcase how the flexible architecture of Wayang enables seamless integration with multiple heterogeneous data systems and how the query optimizer can lead to better performance.
Publication metrics
PlumX, opens in new tab
Citations
2
Captures
1
Funding Details
The work is supported by the Carlsberg Foundation (CF-23-0836),the National Natural Science Foundation of China (No. 62272168),the Brazilian CNPq funding agency (No. 312100/2021-3), and theGerman Federal Ministry of Education and Research (BIFOLD24Band 01IS17052 as Software Campus project PolyDB)
Access to documents
Related Event
Title
Management of Data
Event type
ConferenceDate
22/06/2025 - 27/06/2025Location
BerlinBerlinGermany
