DBScholar

Back to papers

HELIX: Holistic Optimization for Accelerating Iterative Machine Learning

Summary: HELIX holistically optimizes iterative ML workflows, using a Scala DSL and selectively caching, reusing, or recomputing intermediates across preprocessing, modeling, and learning iterations. It formulates reuse as MAX-FLOW and caching as NP-hard, with heuristics yielding up to 19× speedups. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
h3e9ca743981a1d21
Venue
VLDB
Year
2019
Pagerank
0.00010208225
Overall Rank
1,568 | 89.47%
DOI
10.14778/3297753.3297763
PDF
Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{xin_vldb19,
        title = {{HELIX: Holistic Optimization for Accelerating Iterative Machine Learning}},
        author = {Xin, Doris and Macke, Stephen and Ma, Litian and Liu, Jialin and Song, Shuchen and Parameswaran, Aditya},
        journal = {PVLDB},
        series = {{VLDB} '19},
        volume = {12},
        number = {4},
        pages = {446--460},
        doi = {10.14778/3297753.3297763},
        url = {https://doi.org/10.14778/3297753.3297763},
        year = {2019}
}

Incoming Citations (Sorted by Pagerank)

Showing 30 of 30 citing papers.

Rank Citing Paper Year Venue Pagerank
1,370 Towards Scalable Dataframe Systems 2020 VLDB 0.00010895207
1,669 SystemDS: A Declarative Machine Learning System for the End-to-End Data Science Lifecycle 2020 CIDR 9.9324573e-05
2,189 Production Machine Learning Pipelines: Empirical Analysis and Optimization Opportunities 2021 SIGMOD 8.8854572e-05
2,833 Cost Models for Big Data Query Processing: Learning, Retrofitting, and Our Findings 2020 SIGMOD 7.9539771e-05
3,100 Lux: Always-on Visualization Recommendations for Exploratory Dataframe Workflows 2022 VLDB 7.64814e-05
3,168 HELIX: Accelerating Human-in-the-loop Machine Learning 2018 VLDB 7.5692753e-05
4,097 Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches 2021 VLDB 6.8064316e-05
4,334 LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems 2021 SIGMOD 6.6537801e-05
4,721 OmniFair: A Declarative System for Model-Agnostic Group Fairness in Machine Learning 2021 SIGMOD 6.451752e-05
5,574 Saga: A Scalable Framework for Optimizing Data Cleaning Pipelines for Machine Learning Applications 2023 SIGMOD 6.0773771e-05
5,794 Optimizing Machine Learning Workloads in Collaborative Environments 2020 SIGMOD 5.9906542e-05
5,933 Doing More with Less: Characterizing Dataset Downsampling for AutoML 2021 VLDB 5.9393751e-05
6,222 Materialization and Reuse Optimizations for Production Data Science Pipelines 2022 SIGMOD 5.8446676e-05
6,656 Hindsight Logging for Model Training 2021 VLDB 5.7174927e-05
6,666 UPLIFT: Parallelization Strategies for Feature Transformations in Machine Learning Workloads 2022 VLDB 5.7144587e-05
7,102 DeepEverest: Accelerating Declarative Top-K Queries for Deep Neural Network Interpretation 2022 VLDB 5.5991152e-05
7,544 Automating and Optimizing Data-Centric What-If Analyses on Native Machine Learning Pipelines 2023 SIGMOD 5.496984e-05
7,816 Nautilus: An Optimized System for Deep Transfer Learning over Evolving Training Datasets 2022 SIGMOD 5.446446e-05
7,843 ExDRa: Exploratory Data Science on Federated Raw Data 2021 SIGMOD 5.4406331e-05
8,083 Provenance-Enabled Explainable AI 2024 SIGMOD 5.3917406e-05
9,565 Intermittent Human-in-the-Loop Model Selection using Cerebro: A Demonstration 2021 VLDB 5.1547835e-05
9,714 Hippo: Sharing Computations in Hyper-Parameter Optimization 2022 VLDB 5.1347788e-05
10,002 Flow with FlorDB: Incremental Context Maintenance for the Machine Learning Lifecycle 2025 CIDR 5.0954911e-05
10,048 The Image Calculator: 10x Faster Image-AI Inference by Replacing JPEG with Self-designing Storage Format 2024 SIGMOD 5.0896901e-05
10,285 ElasticNotebook: Enabling Live Migration for Computational Notebooks 2024 VLDB 5.0431349e-05
10,732 CAPS: Cost-Aware ML Pipeline Selection 2026 VLDB 4.9769913e-05
10,907 stratum: A System Infrastructure for Massive Agent-Centric ML Workloads 2026 VLDB 4.9769913e-05
11,185 Alsatian: Optimizing Model Search for Deep Transfer Learning 2025 SIGMOD 4.9769913e-05
11,987 Enforcing Constraints for Machine Learning Systems via Declarative Feature Selection: An Experimental Study 2021 SIGMOD 4.9769913e-05
12,192 Enabling Data Science for the Majority 2019 VLDB 4.9769913e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 19 of 19 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
6 Pig Latin: A Not-So-Foreign Language for Data Processing 2008 SIGMOD 0.0010515896
22 Distributed GraphLab: A Framework for Machine Learning and Data Mining in the Cloud 2012 VLDB 0.00055938421
23 Spark SQL: Relational Data Processing in Spark 2015 SIGMOD 0.00055384955
205 Snorkel: Rapid Training Data Creation with Weak Supervision 2018 VLDB 0.00025171314
292 LINQ: Reconciling Objects, Relations and XML in the .NET Framework 2006 SIGMOD 0.00021937893
654 Materialization Optimizations for Feature Selection Workloads 2014 SIGMOD 0.00015096817
731 Learning Generalized Linear Models Over Normalized Data 2015 SIGMOD 0.00014400356
779 To Join or Not to Join? Thinking Twice about Joins before Feature Selection 2016 SIGMOD 0.00014048128
1,193 Weld: A Common Runtime for High Performance Data Analytics 2017 CIDR 0.00011582619
1,257 Towards Linear Algebra over Normalized Data 2017 VLDB 0.0001130959
1,445 An Architecture for Compiling UDF-centric Workflows 2015 VLDB 0.00010628379
1,502 VisTrails: Visualization meets Data Management 2006 SIGMOD 0.00010454991
1,692 MISTIQUE: A System to Store and Query Model Intermediates for Model Diagnosis 2018 SIGMOD 9.8526476e-05
1,747 Selecting Subexpressions to Materialize at Datacenter Scale 2018 VLDB 9.7303647e-05
1,925 ReStore: Reusing Results of MapReduce Jobs 2012 VLDB 9.3643089e-05
2,587 Brainwash: A Data System for Feature Engineering 2013 CIDR 8.2523942e-05
3,168 HELIX: Accelerating Human-in-the-loop Machine Learning 2018 VLDB 7.5692753e-05
3,373 F: Regression Models over Factorized Views 2016 VLDB 7.3627128e-05
4,693 The "Big Data" Ecosystem at LinkedIn 2013 SIGMOD 6.4654777e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 1,082 Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML 2014 VLDB
2 6,222 Materialization and Reuse Optimizations for Production Data Science Pipelines 2022 SIGMOD
3 4,334 LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems 2021 SIGMOD
4 7,544 Automating and Optimizing Data-Centric What-If Analyses on Native Machine Learning Pipelines 2023 SIGMOD
5 10,005 cedar: Optimized and Unified Machine Learning Input Data Pipelines 2025 VLDB
6 6,146 Efficient Construction of Approximate Ad-Hoc ML models Through Materialization and Reuse 2018 VLDB
7 12,453 Shared Execution of Recurring Workloads in MapReduce 2015 VLDB
8 9,801 Efficient LLM Serving for Agentic Workflows: A Data Systems Perspective 2026 SIGMOD
9 2,228 Spinning Fast Iterative Data Flows 2012 VLDB
10 3,168 HELIX: Accelerating Human-in-the-loop Machine Learning 2018 VLDB