DBScholar

Back to papers

SPOOF: Sum-Product Optimization and Operator Fusion for Large-Scale Machine Learning

Summary: Introduces Spoof, an automatic framework that unifies algebraic simplification (sum-product) rewrites and operator fusion/codegen for ML DAGs to exploit linear-algebra properties and sparsity. Produces fused kernels with performance close to hand-tuned code and modest compile overhead. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID
h50407d76bef9dd62
Venue
CIDR
Year
2017
Pagerank
7.4065701e-05
Overall Rank
3,331 | 77.68%
DOI
-
PDF
Download (CC BY 3.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{elgamal_cidr17,
        address = {Amsterdam, Netherlands},
        series = {{CIDR} '17},
        title = {{SPOOF: Sum-Product Optimization and Operator Fusion for Large-Scale Machine Learning}},
        booktitle = {Proceedings of the {Conference} on {Innovative} {Data} {Systems} {Research}},
        author = {Elgamal, Tarek and Luo, Shangyu and Boehm, Matthias and Evfimievski, Alexandre V. and Tatikonda, Shirish and Reinwald, Berthold and Sen, Prithviraj},
        year = {2017}
}

Incoming Citations (Sorted by Pagerank)

Showing 15 of 15 citing papers.

Rank Citing Paper Year Venue Pagerank
318 Worst-Case Optimal Join Algorithms: Techniques, Results, and Open Problems 2018 PODS 0.00021178303
1,200 Towards Linear Algebra over Normalized Data 2017 VLDB 0.00011524945
1,226 Data Management in Machine Learning: Challenges, Techniques, and Systems 2017 SIGMOD 0.00011432354
2,204 Enabling and Optimizing Non-linear Feature Interactions in Factorized Linear Algebra 2019 SIGMOD 8.8531297e-05
2,278 An Intermediate Representation for Optimizing Machine Learning Pipelines 2019 VLDB 8.6993865e-05
2,673 A Layered Aggregate Engine for Analytics Workloads 2019 SIGMOD 8.1276375e-05
2,974 In-Database Learning with Sparse Tensors 2018 PODS 7.7812156e-05
3,104 On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML 2018 VLDB 7.6281929e-05
4,329 MNC: Structure-Exploiting Sparsity Estimation for Matrix Expressions 2019 SIGMOD 6.64569e-05
4,354 LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems 2021 SIGMOD 6.6318545e-05
4,505 SPORES: Sum-Product Optimization via Relational Equality Saturation for Large Scale Linear Algebra 2020 VLDB 6.5561966e-05
6,679 UPLIFT: Parallelization Strategies for Feature Transformations in Machine Learning Workloads 2022 VLDB 5.6956362e-05
8,545 FuseME: Distributed Matrix Computation Engine based on Cuboid-based Fused Operator and Plan Generation 2022 SIGMOD 5.3036987e-05
10,903 ReSequel: Robust LLM-assisted Query Rewriting and Optimization using Templatization and Sampling 2026 VLDB 4.9605343e-05
11,896 Redundancy Elimination in Distributed Matrix Computation 2022 SIGMOD 4.9605343e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 23 of 23 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
21 Efficiently Compiling Efficient Query Plans for Modern Hardware 2011 VLDB 0.00056737487
73 Including Group-By in Query Optimization 1994 VLDB 0.00037420958
213 Eager Aggregation and Lazy Aggregation 1995 VLDB 0.00024695393
357 FAQ: Questions Asked Frequently 2016 PODS 0.00020048899
415 SystemML: Declarative Machine Learning on Spark 2016 VLDB 0.00018619173
498 Building Efficient Query Engines in a High-Level Language 2014 VLDB 0.00017323427
506 Towards a Unified Architecture for in-RDBMS Analytics 2012 SIGMOD 0.00017158546
522 Learning Linear Regression Models over Factorized Joins 2016 SIGMOD 0.00016893112
731 Learning Generalized Linear Models Over Normalized Data 2015 SIGMOD 0.00014363943
848 Aggregation and Ordering in Factorised Databases 2013 VLDB 0.00013463236
851 Scaling Factorization Machines to Relational Data 2013 VLDB 0.00013448823
894 Data Blocks: Hybrid OLTP and OLAP on Compressed Storage using both Vectorization and Compilation 2016 SIGMOD 0.00013179915
1,050 RIOT: I/O-Efficient Numerical Computing without SQL 2009 CIDR 0.00012291671
1,449 An Architecture for Compiling UDF-centric Workflows 2015 VLDB 0.00010597074
1,615 Compressed Linear Algebra for Large-Scale Machine Learning 2016 VLDB 0.00010054378
1,756 How to Architect a Query Compiler 2016 SIGMOD 9.7053947e-05
2,250 Cumulon: Optimizing Statistical Data Analysis in the Cloud 2013 SIGMOD 8.7477605e-05
3,510 Fast Queries Over Heterogeneous Data Through Engine Customization 2016 VLDB 7.2263115e-05
4,134 Resource Elasticity for Large-Scale Machine Learning 2015 SIGMOD 6.7721426e-05
4,435 Estimating Compilation Time of a Query Optimizer 2003 SIGMOD 6.5858211e-05
6,411 Profiling R on a Contemporary Processor 2015 VLDB 5.7765871e-05
7,791 DBToaster: Agile Views in a Dynamic Data Management System 2011 CIDR 5.4352962e-05
7,801 Measuring and Optimizing Distributed Array Programs 2016 VLDB 5.4336618e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 278 Accelerating Machine Learning Inference with Probabilistic Predicates 2018 SIGMOD
2 5,126 Steering Query Optimizers: A Practical Take on Big Data Workloads 2021 SIGMOD
3 8,710 Galley: Modern Query Optimization for Sparse Tensor Programs 2025 SIGMOD
4 10,525 EncoderForge: Generating Efficient SQL for Encoders in Machine Learning Inference Pipelines 2026 SIGMOD
5 2,204 Enabling and Optimizing Non-linear Feature Interactions in Factorized Linear Algebra 2019 SIGMOD
6 8,805 Towards A Polyglot Framework for Factorized ML 2021 VLDB
7 2,278 An Intermediate Representation for Optimizing Machine Learning Pipelines 2019 VLDB
8 6,294 Incorporating Super-Operators in Big-Data Query Optimizers 2020 VLDB
9 3,104 On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML 2018 VLDB
10 4,505 SPORES: Sum-Product Optimization via Relational Equality Saturation for Large Scale Linear Algebra 2020 VLDB