DBScholar

Back to papers

Juggler: Autonomous Cost Optimization and Performance Prediction of Big Data Applications

Summary: Autonomously selects datasets to cache and recommends cluster configurations for in-memory iterative big-data workloads. 90% prediction accuracy; optimal/near-optimal configs in ~50% of cases; runtime to 25% and cost to 58% of baseline. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
6406
Venue
SIGMOD
Year
2022
Pagerank
5.093636e-05
Overall Rank
11,539 | 20.84%
DOI
10.1145/3514221.3517892

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

BibTeX Citation

@inproceedings{alsayeh_sigmod22,
        title = {{Juggler: Autonomous Cost Optimization and Performance Prediction of Big Data Applications}},
        author = {Al-Sayeh, Hani and Memishi, Bunjamin and Jibril, Muhammad Attahir and Paradies, Marcus and Sattler, Kai-Uwe},
        series = {{SIGMOD} '22},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3514221.3517892},
        url = {https://dl.acm.org/doi/10.1145/3514221.3517892},
        year = {2022}
}

Incoming Citations (Sorted by Pagerank)

Showing 2 of 2 citing papers.

Rank Citing Paper Year Venue Pagerank
11,264 Agile-Ant: Self-managing Distributed Cache Management for Cost Optimization of Big Data Applications 2024 VLDB 5.093636e-05
11,603 SparkCAD: Caching Anomalies Detector for Spark Applications 2022 VLDB 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 14 of 14 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
24 Spark SQL: Relational Data Processing in Spark 2015 SIGMOD 0.00054865648
84 Learned Cardinalities: Estimating Correlated Joins with Deep Learning 2019 CIDR 0.00035838391
401 Deep Unsupervised Cardinality Estimation 2020 VLDB 0.00019092557
415 SystemML: Declarative Machine Learning on Spark 2016 VLDB 0.0001888524
694 Cardinality Estimation Done Right: Index-Based Join Sampling 2017 CIDR 0.00014911698
895 Runtime Measurements in the Cloud: Observing, Analyzing, and Reducing Variance 2010 VLDB 0.00013357681
923 Starfish: A Self-tuning System for Big Data Analytics 2011 CIDR 0.00013189886
1,686 Black or White? How to Develop an AutoTuner for Memory-based Analytics 2020 SIGMOD 0.00010008686
1,765 Selecting Subexpressions to Materialize at Datacenter Scale 2018 VLDB 9.8079546e-05
2,404 Cardinality Estimation Using Sample Views with Quality Assurance 2007 SIGMOD 8.6225576e-05
2,456 WATCHMAN: A Data Warehouse Intelligent Cache Manager 1996 VLDB 8.5526697e-05
2,594 Big Data Analytics with Datalog Queries on Spark 2016 SIGMOD 8.3646367e-05
5,287 PREDIcT: Towards Predicting the Runtime of Large Scale Iterative Analytics 2013 VLDB 6.2815429e-05
8,455 Piranha: Optimizing Short Jobs in Hadoop 2013 VLDB 5.4226e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 9,640 Supporting Scalable Analytics with Latency Constraints 2015 VLDB
2 7,281 A General-Purpose Query-Centric Framework for Querying Big Graphs 2016 VLDB
3 4,436 Serving and Optimizing Machine Learning Workflows on Heterogeneous Infrastructures 2023 VLDB
4 11,361 Predicting Query Execution time for JIT Compiled Database Engines 2023 CIDR
5 4,764 ReCache: Reactive Caching for Fast Analytics over Heterogeneous Data 2018 VLDB
6 2,822 Cost Models for Big Data Query Processing: Learning, Retrofitting, and Our Findings 2020 SIGMOD
7 5,699 Optimizing Machine Learning Workloads in Collaborative Environments 2020 SIGMOD
8 5,083 Automating Distributed Tiered Storage Management in Cluster Computing 2020 VLDB
9 4,049 Resource Elasticity for Large-Scale Machine Learning 2015 SIGMOD
10 11,264 Agile-Ant: Self-managing Distributed Cache Management for Cost Optimization of Big Data Applications 2024 VLDB