DBScholar

Back to papers

SPOOF: Sum-Product Optimization and Operator Fusion for Large-Scale Machine Learning

Summary: Introduces Spoof, an automatic framework that unifies algebraic simplification (sum-product) rewrites and operator fusion/codegen for ML DAGs to exploit linear-algebra properties and sparsity. Produces fused kernels with performance close to hand-tuned code and modest compile overhead. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID
297
Venue
CIDR
Year
2017
Pagerank
7.5663058e-05
Overall Rank
3,284 | 77.48%
DOI
-

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{elgamal_cidr17,
        address = {Amsterdam, Netherlands},
        series = {{CIDR} '17},
        title = {{SPOOF: Sum-Product Optimization and Operator Fusion for Large-Scale Machine Learning}},
        booktitle = {Proceedings of the {Conference} on {Innovative} {Data} {Systems} {Research}},
        author = {Elgamal, Tarek and Luo, Shangyu and Boehm, Matthias and Evfimievski, Alexandre V. and Tatikonda, Shirish and Reinwald, Berthold and Sen, Prithviraj},
        year = {2017}
}

Incoming Citations (Sorted by Pagerank)

Showing 14 of 14 citing papers.

Rank Citing Paper Year Venue Pagerank
321 Worst-Case Optimal Join Algorithms: Techniques, Results, and Open Problems 2018 PODS 0.00021283186
1,235 Towards Linear Algebra over Normalized Data 2017 VLDB 0.00011548457
1,250 Data Management in Machine Learning: Challenges, Techniques, and Systems 2017 SIGMOD 0.00011485301
2,179 Enabling and Optimizing Non-linear Feature Interactions in Factorized Linear Algebra 2019 SIGMOD 9.0146333e-05
2,239 An Intermediate Representation for Optimizing Machine Learning Pipelines 2019 VLDB 8.8875753e-05
2,769 A Layered Aggregate Engine for Analytics Workloads 2019 SIGMOD 8.1465406e-05
2,927 In-Database Learning with Sparse Tensors 2018 PODS 7.9531195e-05
3,205 On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML 2018 VLDB 7.6386536e-05
4,240 LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems 2021 SIGMOD 6.809685e-05
4,409 MNC: Structure-Exploiting Sparsity Estimation for Matrix Expressions 2019 SIGMOD 6.7178579e-05
4,976 SPORES: Sum-Product Optimization via Relational Equality Saturation for Large Scale Linear Algebra 2020 VLDB 6.4168322e-05
6,538 UPLIFT: Parallelization Strategies for Feature Transformations in Machine Learning Workloads 2022 VLDB 5.8477764e-05
8,350 FuseME: Distributed Matrix Computation Engine based on Cuboid-based Fused Operator and Plan Generation 2022 SIGMOD 5.4460082e-05
11,537 Redundancy Elimination in Distributed Matrix Computation 2022 SIGMOD 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 23 of 23 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
23 Efficiently Compiling Efficient Query Plans for Modern Hardware 2011 VLDB 0.00054886415
71 Including Group-By in Query Optimization 1994 VLDB 0.00038021159
206 Eager Aggregation and Lazy Aggregation 1995 VLDB 0.00025092273
358 FAQ: Questions Asked Frequently 2016 PODS 0.00020243592
415 SystemML: Declarative Machine Learning on Spark 2016 VLDB 0.0001888524
518 Towards a Unified Architecture for in-RDBMS Analytics 2012 SIGMOD 0.00017167492
534 Building Efficient Query Engines in a High-Level Language 2014 VLDB 0.00017046514
536 Learning Linear Regression Models over Factorized Joins 2016 SIGMOD 0.0001693369
715 Learning Generalized Linear Models Over Normalized Data 2015 SIGMOD 0.00014655327
835 Scaling Factorization Machines to Relational Data 2013 VLDB 0.00013721583
860 Aggregation and Ordering in Factorised Databases 2013 VLDB 0.00013560445
941 Data Blocks: Hybrid OLTP and OLAP on Compressed Storage using both Vectorization and Compilation 2016 SIGMOD 0.00013078348
1,039 RIOT: I/O-Efficient Numerical Computing without SQL 2009 CIDR 0.00012474977
1,442 An Architecture for Compiling UDF-centric Workflows 2015 VLDB 0.00010778486
1,644 Compressed Linear Algebra for Large-Scale Machine Learning 2016 VLDB 0.00010132912
1,797 How to Architect a Query Compiler 2016 SIGMOD 9.7368925e-05
2,217 Cumulon: Optimizing Statistical Data Analysis in the Cloud 2013 SIGMOD 8.9332438e-05
3,638 Fast Queries Over Heterogeneous Data Through Engine Customization 2016 VLDB 7.2338361e-05
4,049 Resource Elasticity for Large-Scale Machine Learning 2015 SIGMOD 6.9369379e-05
4,346 Estimating Compilation Time of a Query Optimizer 2003 SIGMOD 6.7510183e-05
6,276 Profiling R on a Contemporary Processor 2015 VLDB 5.9291284e-05
7,634 DBToaster: Agile Views in a Dynamic Data Management System 2011 CIDR 5.5770904e-05
7,662 Measuring and Optimizing Distributed Array Programs 2016 VLDB 5.5732476e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 295 Accelerating Machine Learning Inference with Probabilistic Predicates 2018 SIGMOD
2 5,059 Steering Query Optimizers: A Practical Take on Big Data Workloads 2021 SIGMOD
3 10,232 EncoderForge: Generating Efficient SQL for Encoders in Machine Learning Inference Pipelines 2026 SIGMOD
4 8,513 Galley: Modern Query Optimization for Sparse Tensor Programs 2025 SIGMOD
5 2,179 Enabling and Optimizing Non-linear Feature Interactions in Factorized Linear Algebra 2019 SIGMOD
6 8,638 Towards A Polyglot Framework for Factorized ML 2021 VLDB
7 2,239 An Intermediate Representation for Optimizing Machine Learning Pipelines 2019 VLDB
8 6,194 Incorporating Super-Operators in Big-Data Query Optimizers 2020 VLDB
9 3,205 On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML 2018 VLDB
10 4,976 SPORES: Sum-Product Optimization via Relational Equality Saturation for Large Scale Linear Algebra 2020 VLDB