DBScholar

Back to papers

On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML

Summary: Exact, cost-based fusion optimization for large-scale ML in SystemML; handles complex operator DAGs and hybrid local/distributed execution. Integrated with candidate exploration and code generation for dense, sparse, and compressed data; up to 22x speedups with negligible compilation overhead. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
11845
Venue
VLDB
Year
2018
Pagerank
7.6386536e-05
Overall Rank
3,205 | 78.02%
DOI
10.14778/3229863.3229865

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{boehm_vldb18,
        title = {{On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML}},
        author = {Boehm, Matthias and Reinwald, Berthold and Hutchison, Dylan and Sen, Prithviraj and Evfimievski, Alexandre V. and Pansare, Niketan},
        journal = {PVLDB},
        series = {{VLDB} '18},
        volume = {11},
        number = {12},
        pages = {1755--1768},
        doi = {10.14778/3229863.3229865},
        url = {https://doi.org/10.14778/3229863.3229865},
        year = {2018}
}

Incoming Citations (Sorted by Pagerank)

Showing 23 of 23 citing papers.

Rank Citing Paper Year Venue Pagerank
1,756 SystemDS: A Declarative Machine Learning System for the End-to-End Data Science Lifecycle 2020 CIDR 9.8172465e-05
2,239 An Intermediate Representation for Optimizing Machine Learning Pipelines 2019 VLDB 8.8875753e-05
4,067 Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches 2021 VLDB 6.9293511e-05
4,240 LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems 2021 SIGMOD 6.809685e-05
4,409 MNC: Structure-Exploiting Sparsity Estimation for Matrix Expressions 2019 SIGMOD 6.7178579e-05
4,976 SPORES: Sum-Product Optimization via Relational Equality Saturation for Large Scale Linear Algebra 2020 VLDB 6.4168322e-05
5,414 Optimizing Tensor Programs on Flexible Storage 2023 SIGMOD 6.2258658e-05
6,538 UPLIFT: Parallelization Strategies for Feature Transformations in Machine Learning Workloads 2022 VLDB 5.8477764e-05
7,160 DAPHNE: An Open and Extensible System Infrastructure for Integrated Data Analysis Pipelines 2022 CIDR 5.6855887e-05
8,096 Efficient Execution of User-Defined Functions in SQL Queries 2023 VLDB 5.4875738e-05
8,230 TOD: GPU-accelerated Outlier Detection via Tensor Operations 2023 VLDB 5.4619615e-05
8,350 FuseME: Distributed Matrix Computation Engine based on Cuboid-based Fused Operator and Plan Generation 2022 SIGMOD 5.4460082e-05
8,606 PreVision: An Out-of-Core Matrix Computation System with Optimal Buffer Replacement 2024 SIGMOD 5.4026249e-05
8,794 AWARE: Workload-aware, Redundancy-exploiting Linear Algebra 2023 SIGMOD 5.370464e-05
8,999 HADAD: A Lightweight Approach for Optimizing Hybrid Complex Analytics Queries 2021 SIGMOD 5.3354529e-05
9,371 Towards an Optimized GROUP BY Abstraction for Large-Scale Machine Learning 2021 VLDB 5.275595e-05
9,436 GIO: Generating Efficient Matrix and Frame Readers for Custom Data Formats by Example 2023 SIGMOD 5.2692207e-05
9,475 BladeDISC: Optimizing Dynamic Shape Machine Learning Workloads via Compiler Approach 2023 SIGMOD 5.2634238e-05
9,917 The UDFBench Benchmark for General-purpose UDF Queries 2025 VLDB 5.1955087e-05
10,232 EncoderForge: Generating Efficient SQL for Encoders in Machine Learning Inference Pipelines 2026 SIGMOD 5.093636e-05
10,836 Quantum Data Management in the NISQ Era 2025 VLDB 5.093636e-05
11,537 Redundancy Elimination in Distributed Matrix Computation 2022 SIGMOD 5.093636e-05
11,669 Hybrid Evaluation for Distributed Iterative Matrix Computation 2021 SIGMOD 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 41 of 41 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
16 MAGIC SETS AND OTHER STRANGE WAYS TO IMPLEMENT LOGIC PROGRAMS (Extended Abstract) 1986 PODS 0.00060089598
23 Efficiently Compiling Efficient Query Plans for Modern Hardware 2011 VLDB 0.00054886415
24 Spark SQL: Relational Data Processing in Spark 2015 SIGMOD 0.00054865648
89 On the Propagation of Errors in the Size of Join Results 1991 SIGMOD 0.00035031529
155 MAD Skills: New Analysis Practices for Big Data 2009 VLDB 0.00028713176
234 Self-Driving Database Management Systems 2017 CIDR 0.00023810722
415 SystemML: Declarative Machine Learning on Spark 2016 VLDB 0.0001888524
534 Building Efficient Query Engines in a High-Level Language 2014 VLDB 0.00017046514
941 Data Blocks: Hybrid OLTP and OLAP on Compressed Storage using both Vectorization and Compilation 2016 SIGMOD 0.00013078348
1,013 Dynamic Programming Strikes Back 2008 SIGMOD 0.00012652549
1,022 A Scalable, Predictable Join Operator for Highly Concurrent Data Warehouses 2009 VLDB 0.00012602841
1,024 The DataPath System: A Data-Centric Analytic Processing Engine for Large Data Warehouses 2010 SIGMOD 0.0001258839
1,079 Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML 2014 VLDB 0.00012258469
1,154 Efficient Exploitation of Similar Subexpressions for Query Processing 2007 SIGMOD 0.00011934202
1,229 Weld: A Common Runtime for High Performance Data Analytics 2017 CIDR 0.00011578425
1,286 Adaptive Optimization of Very Large Join Queries 2018 SIGMOD 0.00011320736
1,298 Analysis of Two Existing and One New Dynamic Programming Algorithm for the Generation of Optimal Bushy Join Trees without Cross Products 2006 VLDB 0.00011259156
1,379 Relaxed Operator Fusion for In-Memory Databases: Making Compilation, Vectorization, and Prefetching Work Together At Last 2018 VLDB 0.00010970894
1,442 An Architecture for Compiling UDF-centric Workflows 2015 VLDB 0.00010778486
1,469 Voodoo - A Vector Algebra for Portable Database Performance on Modern Hardware 2016 VLDB 0.00010678751
1,520 Conditioning Probabilistic Databases 2008 VLDB 0.00010510496
1,574 Pipelined Query Processing in Coprocessor Environments 2018 SIGMOD 0.00010321274
1,644 Compressed Linear Algebra for Large-Scale Machine Learning 2016 VLDB 0.00010132912
1,797 How to Architect a Query Compiler 2016 SIGMOD 9.7368925e-05
1,979 Scalable Join Processing on Very Large RDF Graphs 2009 SIGMOD 9.3621296e-05
2,094 Tupleware: "Big" Data, Big Analytics, Small Clusters 2015 CIDR 9.1819738e-05
2,217 Cumulon: Optimizing Statistical Data Analysis in the Cloud 2013 SIGMOD 8.9332438e-05
2,276 Shared Workload Optimization 2014 VLDB 8.8196376e-05
2,486 Stubby: A Transformation-based Optimizer for MapReduce Workflows 2012 VLDB 8.5143189e-05
2,681 Exploiting Matrix Dependency for Efficient Distributed Matrix Computation 2015 SIGMOD 8.2632778e-05
2,717 Implicit Parallelism through Deep Language Embedding 2015 SIGMOD 8.2102313e-05
3,003 Configuration-Parametric Query Optimization for Physical Design Tuning 2008 SIGMOD 7.8620915e-05
3,268 Efficient and Provable Multi-Query Optimization 2017 PODS 7.5810998e-05
3,284 SPOOF: Sum-Product Optimization and Operator Fusion for Large-Scale Machine Learning 2017 CIDR 7.5663058e-05
3,638 Fast Queries Over Heterogeneous Data Through Engine Customization 2016 VLDB 7.2338361e-05
3,656 Bypassing Joins in Disjunctive Queries 1995 VLDB 7.2224287e-05
3,813 Query Simplification: Graceful Degradation for Join-Order Optimization 2009 SIGMOD 7.1051056e-05
4,049 Resource Elasticity for Large-Scale Machine Learning 2015 SIGMOD 6.9369379e-05
4,866 Micro-architectural Analysis of In-memory OLTP 2016 SIGMOD 6.4720641e-05
7,634 DBToaster: Agile Views in a Dynamic Data Management System 2011 CIDR 5.5770904e-05
7,662 Measuring and Optimizing Distributed Array Programs 2016 VLDB 5.5732476e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 9,675 BlockJoin: Efficient Matrix Partitioning Through Joins 2017 VLDB
2 6,038 Efficient Construction of Approximate Ad-Hoc ML models Through Materialization and Reuse 2018 VLDB
3 9,371 Towards an Optimized GROUP BY Abstraction for Large-Scale Machine Learning 2021 VLDB
4 8,350 FuseME: Distributed Matrix Computation Engine based on Cuboid-based Fused Operator and Plan Generation 2022 SIGMOD
5 6,046 Automatic Optimization of Matrix Implementations for Distributed Machine Learning and Linear Algebra 2021 SIGMOD
6 4,049 Resource Elasticity for Large-Scale Machine Learning 2015 SIGMOD
7 4,976 SPORES: Sum-Product Optimization via Relational Equality Saturation for Large Scale Linear Algebra 2020 VLDB
8 3,284 SPOOF: Sum-Product Optimization and Operator Fusion for Large-Scale Machine Learning 2017 CIDR
9 415 SystemML: Declarative Machine Learning on Spark 2016 VLDB
10 1,079 Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML 2014 VLDB