Database Paper Browser

Back to papers

On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML

Summary: Exact, cost-based fusion optimization for large-scale ML in SystemML; handles complex operator DAGs and hybrid local/distributed execution. Integrated with candidate exploration and code generation for dense, sparse, and compressed data; up to 22x speedups with negligible compilation overhead. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
11658
Venue
VLDB
Year
2018
Pagerank
6.6246708e-05
Overall Rank
3,920 | 72.76%
DOI
10.14778/3229863.3229865

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 22 of 22 citing papers.

Rank Citing Paper Year Venue Pagerank
2,122 SystemDS: A Declarative Machine Learning System for the End-to-End Data Science Lifecycle 2020 CIDR 9.4905306e-05
2,355 An Intermediate Representation for Optimizing Machine Learning Pipelines 2019 VLDB 8.9727612e-05
4,601 Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches 2021 VLDB 6.05274e-05
4,779 LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems 2021 SIGMOD 5.9259373e-05
4,835 MNC: Structure-Exploiting Sparsity Estimation for Matrix Expressions 2019 SIGMOD 5.8861112e-05
5,497 SPORES: Sum-Product Optimization via Relational Equality Saturation for Large Scale Linear Algebra 2020 VLDB 5.4741034e-05
6,157 Optimizing Tensor Programs on Flexible Storage 2023 SIGMOD 5.1755682e-05
7,303 DAPHNE: An Open and Extensible System Infrastructure for Integrated Data Analysis Pipelines 2022 CIDR 4.7632836e-05
8,161 TOD: GPU-accelerated Outlier Detection via Tensor Operations 2023 VLDB 4.5688249e-05
8,258 FuseME: Distributed Matrix Computation Engine based on Cuboid-based Fused Operator and Plan Generation 2022 SIGMOD 4.5424271e-05
8,515 UPLIFT: Parallelization Strategies for Feature Transformations in Machine Learning Workloads 2022 VLDB 4.4901466e-05
8,580 Efficient Execution of User-Defined Functions in SQL Queries 2023 VLDB 4.4876382e-05
8,617 PreVision: An Out-of-Core Matrix Computation System with Optimal Buffer Replacement 2024 SIGMOD 4.479438e-05
8,782 AWARE: Workload-aware, Redundancy-exploiting Linear Algebra 2023 SIGMOD 4.4478585e-05
8,981 HADAD: A Lightweight Approach for Optimizing Hybrid Complex Analytics Queries 2021 SIGMOD 4.4138435e-05
9,225 Towards an Optimized GROUP BY Abstraction for Large-Scale Machine Learning 2021 VLDB 4.3656789e-05
9,331 BladeDISC: Optimizing Dynamic Shape Machine Learning Workloads via Compiler Approach 2023 SIGMOD 4.351469e-05
9,355 GIO: Generating Efficient Matrix and Frame Readers for Custom Data Formats by Example 2023 SIGMOD 4.3484264e-05
9,765 The UDFBench Benchmark for General-purpose UDF Queries 2025 VLDB 4.2815042e-05
10,580 Quantum Data Management in the NISQ Era 2025 VLDB 4.1905499e-05
11,341 Redundancy Elimination in Distributed Matrix Computation 2022 SIGMOD 4.1905499e-05
11,475 Hybrid Evaluation for Distributed Iterative Matrix Computation 2021 SIGMOD 4.1905499e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 41 of 41 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
16 MAGIC SETS AND OTHER STRANGE WAYS TO IMPLEMENT LOGIC PROGRAMS (Extended Abstract) 1986 PODS 0.00099936325
59 Efficiently Compiling Efficient Query Plans for Modern Hardware 2011 VLDB 0.0006445664
66 Spark SQL: Relational Data Processing in Spark 2015 SIGMOD 0.00061707583
100 On the Propagation of Errors in the Size of Join Results 1991 SIGMOD 0.00050033475
169 MAD Skills: New Analysis Practices for Big Data 2009 VLDB 0.00038967371
371 Self-Driving Database Management Systems 2017 CIDR 0.00025382677
557 SystemML: Declarative Machine Learning on Spark 2016 VLDB 0.00020186115
701 Building Efficient Query Engines in a High-Level Language 2014 VLDB 0.00017893039
1,260 Data Blocks: Hybrid OLTP and OLAP on Compressed Storage using both Vectorization and Compilation 2016 SIGMOD 0.00012990853
1,296 The DataPath System: A Data-Centric Analytic Processing Engine for Large Data Warehouses 2010 SIGMOD 0.00012742585
1,344 Dynamic Programming Strikes Back 2008 SIGMOD 0.00012477274
1,407 Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML 2014 VLDB 0.00012163413
1,430 A Scalable, Predictable Join Operator for Highly Concurrent Data Warehouses 2009 VLDB 0.0001202506
1,475 Efficient Exploitation of Similar Subexpressions for Query Processing 2007 SIGMOD 0.00011765071
1,621 Adaptive Optimization of Very Large Join Queries 2018 SIGMOD 0.00011105663
1,730 Conditioning Probabilistic Databases 2008 VLDB 0.00010726683
1,751 Weld: A Common Runtime for High Performance Data Analytics 2017 CIDR 0.00010673874
1,825 Analysis of Two Existing and One New Dynamic Programming Algorithm for the Generation of Optimal Bushy Join Trees without Cross Products 2006 VLDB 0.00010392367
1,865 Relaxed Operator Fusion for In-Memory Databases: Making Compilation, Vectorization, and Prefetching Work Together At Last 2018 VLDB 0.00010271333
1,875 An Architecture for Compiling UDF-centric Workflows 2015 VLDB 0.00010243959
1,970 Compressed Linear Algebra for Large-Scale Machine Learning 2016 VLDB 9.9024431e-05
2,019 Voodoo - A Vector Algebra for Portable Database Performance on Modern Hardware 2016 VLDB 9.7814175e-05
2,292 Pipelined Query Processing in Coprocessor Environments 2018 SIGMOD 9.0884645e-05
2,383 How to Architect a Query Compiler 2016 SIGMOD 8.9198524e-05
2,407 Scalable Join Processing on Very Large RDF Graphs 2009 SIGMOD 8.8702781e-05
2,421 Tupleware: "Big" Data, Big Analytics, Small Clusters 2015 CIDR 8.8471956e-05
2,672 Cumulon: Optimizing Statistical Data Analysis in the Cloud 2013 SIGMOD 8.3334428e-05
2,754 Stubby: A Transformation-based Optimizer for MapReduce Workflows 2012 VLDB 8.1720428e-05
2,823 Implicit Parallelism through Deep Language Embedding 2015 SIGMOD 8.0593793e-05
2,855 Exploiting Matrix Dependency for Efficient Distributed Matrix Computation 2015 SIGMOD 8.013421e-05
2,928 Shared Workload Optimization 2014 VLDB 7.881485e-05
3,276 Configuration-Parametric Query Optimization for Physical Design Tuning 2008 SIGMOD 7.2880761e-05
3,505 Efficient and Provable Multi-Query Optimization 2017 PODS 7.0304901e-05
3,667 Bypassing Joins in Disjunctive Queries 1995 VLDB 6.8587775e-05
4,319 Fast Queries Over Heterogeneous Data Through Engine Customization 2016 VLDB 6.2823814e-05
4,508 SPOOF: Sum-Product Optimization and Operator Fusion for Large-Scale Machine Learning 2017 CIDR 6.1261819e-05
4,734 Query Simplification: Graceful Degradation for Join-Order Optimization 2009 SIGMOD 5.9553181e-05
4,807 Resource Elasticity for Large-Scale Machine Learning 2015 SIGMOD 5.9045148e-05
5,273 Micro-architectural Analysis of In-memory OLTP 2016 SIGMOD 5.5919449e-05
7,828 Measuring and Optimizing Distributed Array Programs 2016 VLDB 4.6374634e-05
7,880 DBToaster: Agile Views in a Dynamic Data Management System 2011 CIDR 4.6250755e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

Overall Rank Paper Year Venue Pagerank
9,442 BlockJoin: Efficient Matrix Partitioning Through Joins 2017 VLDB 4.3384032e-05
6,329 Efficient Construction of Approximate Ad-Hoc ML models Through Materialization and Reuse 2018 VLDB 5.1030159e-05
9,225 Towards an Optimized GROUP BY Abstraction for Large-Scale Machine Learning 2021 VLDB 4.3656789e-05
8,258 FuseME: Distributed Matrix Computation Engine based on Cuboid-based Fused Operator and Plan Generation 2022 SIGMOD 4.5424271e-05
6,194 Automatic Optimization of Matrix Implementations for Distributed Machine Learning and Linear Algebra 2021 SIGMOD 5.1592984e-05
4,807 Resource Elasticity for Large-Scale Machine Learning 2015 SIGMOD 5.9045148e-05
5,497 SPORES: Sum-Product Optimization via Relational Equality Saturation for Large Scale Linear Algebra 2020 VLDB 5.4741034e-05
4,508 SPOOF: Sum-Product Optimization and Operator Fusion for Large-Scale Machine Learning 2017 CIDR 6.1261819e-05
557 SystemML: Declarative Machine Learning on Spark 2016 VLDB 0.00020186115
1,407 Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML 2014 VLDB 0.00012163413