Skip to search boxSkip to navigationSkip to main content

Apache Wayang in Action: Enabling Data Systems Integration via a Unified Data Analytics Framework.

  • Kaustubh Beedkar
    ,
  • Aurélien Bertrand
    ,
  • Haralampos Gavriilidis
    ,
  • Augusto José Fonseca
    ,
  • ,
  • Mingxi Liu
Research Output:
Conference Article in Proceeding or Book/Report chapter
Article in proceedings
Peer-review

Open access

Publication Information

Output type

Research Output:
Conference Article in Proceeding or Book/Report chapter
Article in proceedings
Peer-review

Original language

English

Pages from-to (Number of pages)

Pages 35-38 (4 pages)

Publication milestones

  • Published - 22/06/2025

Publication status

Published - 22/06/2025

Place of publication

New York, USA

Publisher

Association for Computing Machinery, United States
9798400715648

ISBN (Electronic)

9798400715648

Publication IDs

  • Scopus: 105010210649

Host publication title

Companion of the 2025 International Conference on Management of Data

Abstract

Apache Wayang is an open-source framework, which provides a systematic and efficient solution for unifying data analytics over disparate data sources and via integrating multiple heterogeneous data systems. It achieves that by decoupling applications from the underlying systems. In addition, it provides an optimizer so that users do not have to specify the platforms on which their pipeline should run but the optimizer can determine the best way given a cost metric. In this demonstration, we showcase how the flexible architecture of Wayang enables seamless integration with multiple heterogeneous data systems and how the query optimizer can lead to better performance.

Publication metrics

PlumX, opens in new tab

Citations
2
Captures
1

Funding Details

The work is supported by the Carlsberg Foundation (CF-23-0836),the National Natural Science Foundation of China (No. 62272168),the Brazilian CNPq funding agency (No. 312100/2021-3), and theGerman Federal Ministry of Education and Research (BIFOLD24Band 01IS17052 as Software Campus project PolyDB)

Related Event

Title

Management of Data

Event type

Conference

Date

22/06/2025 - 27/06/2025

Location

BerlinBerlinGermany