DBScholar

Back to papers

On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML

Summary: Exact, cost-based fusion optimization for large-scale ML in SystemML; handles complex operator DAGs and hybrid local/distributed execution. Integrated with candidate exploration and code generation for dense, sparse, and compressed data; up to 22x speedups with negligible compilation overhead. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h08c62adea104db11
Venue
VLDB
Year
2018
Pagerank
7.649219e-05
Overall Rank
3,101 | 79.16%
DOI
10.14778/3229863.3229865

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{boehm_vldb18,
        title = {{On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML}},
        author = {Boehm, Matthias and Reinwald, Berthold and Hutchison, Dylan and Sen, Prithviraj and Evfimievski, Alexandre V. and Pansare, Niketan},
        journal = {PVLDB},
        series = {{VLDB} '18},
        volume = {11},
        number = {12},
        pages = {1755--1768},
        doi = {10.14778/3229863.3229865},
        url = {https://doi.org/10.14778/3229863.3229865},
        year = {2018}
}

Incoming Citations (Sorted by Pagerank)

Showing 25 of 25 citing papers.

Rank Citing Paper Year Venue Pagerank
1,668 SystemDS: A Declarative Machine Learning System for the End-to-End Data Science Lifecycle 2020 CIDR 9.9371612e-05
2,264 An Intermediate Representation for Optimizing Machine Learning Pipelines 2019 VLDB 8.7289107e-05
4,095 Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches 2021 VLDB 6.8095767e-05
4,330 MNC: Structure-Exploiting Sparsity Estimation for Matrix Expressions 2019 SIGMOD 6.6595681e-05
4,334 LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems 2021 SIGMOD 6.6569314e-05
4,974 SPORES: Sum-Product Optimization via Relational Equality Saturation for Large Scale Linear Algebra 2020 VLDB 6.3318399e-05
5,439 Optimizing Tensor Programs on Flexible Storage 2023 SIGMOD 6.1279464e-05
6,662 UPLIFT: Parallelization Strategies for Feature Transformations in Machine Learning Workloads 2022 VLDB 5.7171651e-05
6,878 DAPHNE: An Open and Extensible System Infrastructure for Integrated Data Analysis Pipelines 2022 CIDR 5.657878e-05
7,983 Efficient Execution of User-Defined Functions in SQL Queries 2023 VLDB 5.4131297e-05
8,384 AWARE: Workload-aware, Redundancy-exploiting Linear Algebra 2023 SIGMOD 5.3421754e-05
8,400 TOD: GPU-accelerated Outlier Detection via Tensor Operations 2023 VLDB 5.3395906e-05
8,521 FuseME: Distributed Matrix Computation Engine based on Cuboid-based Fused Operator and Plan Generation 2022 SIGMOD 5.3238144e-05
8,768 PreVision: An Out-of-Core Matrix Computation System with Optimal Buffer Replacement 2024 SIGMOD 5.2814045e-05
9,157 HADAD: A Lightweight Approach for Optimizing Hybrid Complex Analytics Queries 2021 SIGMOD 5.2169683e-05
9,549 GIO: Generating Efficient Matrix and Frame Readers for Custom Data Formats by Example 2023 SIGMOD 5.1599622e-05
9,556 Towards an Optimized GROUP BY Abstraction for Large-Scale Machine Learning 2021 VLDB 5.1572248e-05
9,656 BladeDISC: Optimizing Dynamic Shape Machine Learning Workloads via Compiler Approach 2023 SIGMOD 5.1453267e-05
9,694 The UDFBench Benchmark for General-purpose UDF Queries 2025 VLDB 5.1396592e-05
10,448 EncoderForge: Generating Efficient SQL for Encoders in Machine Learning Inference Pipelines 2026 SIGMOD 4.9793485e-05
10,858 Sema: A High-performance System for LLM-based Semantic Query Processing 2026 VLDB 4.9793485e-05
10,898 stratum: A System Infrastructure for Massive Agent-Centric ML Workloads 2026 VLDB 4.9793485e-05
11,243 Quantum Data Management in the NISQ Era 2025 VLDB 4.9793485e-05
11,846 Redundancy Elimination in Distributed Matrix Computation 2022 SIGMOD 4.9793485e-05
11,976 Hybrid Evaluation for Distributed Iterative Matrix Computation 2021 SIGMOD 4.9793485e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 41 of 41 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
18 MAGIC SETS AND OTHER STRANGE WAYS TO IMPLEMENT LOGIC PROGRAMS (Extended Abstract) 1986 PODS 0.00059023577
21 Efficiently Compiling Efficient Query Plans for Modern Hardware 2011 VLDB 0.00056855599
23 Spark SQL: Relational Data Processing in Spark 2015 SIGMOD 0.00055406774
91 On the Propagation of Errors in the Size of Join Results 1991 SIGMOD 0.0003475226
154 MAD Skills: New Analysis Practices for Big Data 2009 VLDB 0.00028579704
224 Self-Driving Database Management Systems 2017 CIDR 0.00024013745
415 SystemML: Declarative Machine Learning on Spark 2016 VLDB 0.0001865959
495 Building Efficient Query Engines in a High-Level Language 2014 VLDB 0.00017370758
884 Dynamic Programming Strikes Back 2008 SIGMOD 0.00013267935
906 Data Blocks: Hybrid OLTP and OLAP on Compressed Storage using both Vectorization and Compilation 2016 SIGMOD 0.00013160654
1,034 A Scalable, Predictable Join Operator for Highly Concurrent Data Warehouses 2009 VLDB 0.00012394538
1,040 The DataPath System: A Data-Centric Analytic Processing Engine for Large Data Warehouses 2010 SIGMOD 0.00012364063
1,081 Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML 2014 VLDB 0.00012123917
1,131 Efficient Exploitation of Similar Subexpressions for Query Processing 2007 SIGMOD 0.0001189909
1,186 Adaptive Optimization of Very Large Join Queries 2018 SIGMOD 0.0001160797
1,193 Weld: A Common Runtime for High Performance Data Analytics 2017 CIDR 0.0001158809
1,301 Analysis of Two Existing and One New Dynamic Programming Algorithm for the Generation of Optimal Bushy Join Trees without Cross Products 2006 VLDB 0.00011112842
1,341 Relaxed Operator Fusion for In-Memory Databases: Making Compilation, Vectorization, and Prefetching Work Together At Last 2018 VLDB 0.00010968512
1,444 An Architecture for Compiling UDF-centric Workflows 2015 VLDB 0.0001063181
1,473 Voodoo - A Vector Algebra for Portable Database Performance on Modern Hardware 2016 VLDB 0.00010557973
1,533 Pipelined Query Processing in Coprocessor Environments 2018 SIGMOD 0.00010332035
1,549 Conditioning Probabilistic Databases 2008 VLDB 0.00010288725
1,614 Compressed Linear Algebra for Large-Scale Machine Learning 2016 VLDB 0.00010071891
1,742 How to Architect a Query Compiler 2016 SIGMOD 9.7378418e-05
2,026 Scalable Join Processing on Very Large RDF Graphs 2009 SIGMOD 9.1624074e-05
2,123 Tupleware: "Big" Data, Big Analytics, Small Clusters 2015 CIDR 9.0060385e-05
2,225 Shared Workload Optimization 2014 VLDB 8.8081001e-05
2,247 Cumulon: Optimizing Statistical Data Analysis in the Cloud 2013 SIGMOD 8.7585767e-05
2,527 Stubby: A Transformation-based Optimizer for MapReduce Workflows 2012 VLDB 8.3425785e-05
2,723 Exploiting Matrix Dependency for Efficient Distributed Matrix Computation 2015 SIGMOD 8.0944934e-05
2,754 Implicit Parallelism through Deep Language Embedding 2015 SIGMOD 8.0534972e-05
3,041 Configuration-Parametric Query Optimization for Physical Design Tuning 2008 SIGMOD 7.7215151e-05
3,214 Efficient and Provable Multi-Query Optimization 2017 PODS 7.5269127e-05
3,330 SPOOF: Sum-Product Optimization and Operator Fusion for Large-Scale Machine Learning 2017 CIDR 7.4173693e-05
3,505 Fast Queries Over Heterogeneous Data Through Engine Customization 2016 VLDB 7.2508161e-05
3,720 Bypassing Joins in Disjunctive Queries 1995 VLDB 7.0715239e-05
3,797 Query Simplification: Graceful Degradation for Join-Order Optimization 2009 SIGMOD 7.0163619e-05
4,116 Resource Elasticity for Large-Scale Machine Learning 2015 SIGMOD 6.7961306e-05
4,899 Micro-architectural Analysis of In-memory OLTP 2016 SIGMOD 6.3655167e-05
7,771 DBToaster: Agile Views in a Dynamic Data Management System 2011 CIDR 5.4553987e-05
7,789 Measuring and Optimizing Distributed Array Programs 2016 VLDB 5.4521754e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 9,822 BlockJoin: Efficient Matrix Partitioning Through Joins 2017 VLDB
2 6,143 Efficient Construction of Approximate Ad-Hoc ML models Through Materialization and Reuse 2018 VLDB
3 9,556 Towards an Optimized GROUP BY Abstraction for Large-Scale Machine Learning 2021 VLDB
4 8,521 FuseME: Distributed Matrix Computation Engine based on Cuboid-based Fused Operator and Plan Generation 2022 SIGMOD
5 6,169 Automatic Optimization of Matrix Implementations for Distributed Machine Learning and Linear Algebra 2021 SIGMOD
6 4,116 Resource Elasticity for Large-Scale Machine Learning 2015 SIGMOD
7 4,974 SPORES: Sum-Product Optimization via Relational Equality Saturation for Large Scale Linear Algebra 2020 VLDB
8 3,330 SPOOF: Sum-Product Optimization and Operator Fusion for Large-Scale Machine Learning 2017 CIDR
9 415 SystemML: Declarative Machine Learning on Spark 2016 VLDB
10 1,081 Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML 2014 VLDB