DBScholar

Back to papers

SPOOF: Sum-Product Optimization and Operator Fusion for Large-Scale Machine Learning

Summary: Introduces Spoof, an automatic framework that unifies algebraic simplification (sum-product) rewrites and operator fusion/codegen for ML DAGs to exploit linear-algebra properties and sparsity. Produces fused kernels with performance close to hand-tuned code and modest compile overhead. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID
h50407d76bef9dd62
Venue
CIDR
Year
2017
Pagerank
7.4138851e-05
Overall Rank
3,331 | 77.62%
DOI
-
PDF
Download (CC BY 3.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{elgamal_cidr17,
        address = {Amsterdam, Netherlands},
        series = {{CIDR} '17},
        title = {{SPOOF: Sum-Product Optimization and Operator Fusion for Large-Scale Machine Learning}},
        booktitle = {Proceedings of the {Conference} on {Innovative} {Data} {Systems} {Research}},
        author = {Elgamal, Tarek and Luo, Shangyu and Boehm, Matthias and Evfimievski, Alexandre V. and Tatikonda, Shirish and Reinwald, Berthold and Sen, Prithviraj},
        year = {2017}
}

Incoming Citations (Sorted by Pagerank)

Showing 15 of 15 citing papers.

Rank Citing Paper Year Venue Pagerank
315 Worst-Case Optimal Join Algorithms: Techniques, Results, and Open Problems 2018 PODS 0.00021236408
1,223 Data Management in Machine Learning: Challenges, Techniques, and Systems 2017 SIGMOD 0.00011468426
1,257 Towards Linear Algebra over Normalized Data 2017 VLDB 0.0001130959
2,201 Enabling and Optimizing Non-linear Feature Interactions in Factorized Linear Algebra 2019 SIGMOD 8.8708356e-05
2,266 An Intermediate Representation for Optimizing Machine Learning Pipelines 2019 VLDB 8.7248802e-05
2,663 A Layered Aggregate Engine for Analytics Workloads 2019 SIGMOD 8.1542952e-05
2,978 In-Database Learning with Sparse Tensors 2018 PODS 7.7872011e-05
3,103 On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML 2018 VLDB 7.6456038e-05
4,330 MNC: Structure-Exploiting Sparsity Estimation for Matrix Expressions 2019 SIGMOD 6.6564176e-05
4,334 LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems 2021 SIGMOD 6.6537801e-05
4,975 SPORES: Sum-Product Optimization via Relational Equality Saturation for Large Scale Linear Algebra 2020 VLDB 6.3289021e-05
6,666 UPLIFT: Parallelization Strategies for Feature Transformations in Machine Learning Workloads 2022 VLDB 5.7144587e-05
8,528 FuseME: Distributed Matrix Computation Engine based on Cuboid-based Fused Operator and Plan Generation 2022 SIGMOD 5.3212942e-05
10,842 ReSequel: Robust LLM-assisted Query Rewriting and Optimization using Templatization and Sampling 2026 VLDB 4.9769913e-05
11,852 Redundancy Elimination in Distributed Matrix Computation 2022 SIGMOD 4.9769913e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 23 of 23 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
21 Efficiently Compiling Efficient Query Plans for Modern Hardware 2011 VLDB 0.00056835296
73 Including Group-By in Query Optimization 1994 VLDB 0.0003750677
213 Eager Aggregation and Lazy Aggregation 1995 VLDB 0.00024753576
357 FAQ: Questions Asked Frequently 2016 PODS 0.00020013731
416 SystemML: Declarative Machine Learning on Spark 2016 VLDB 0.00018650998
495 Building Efficient Query Engines in a High-Level Language 2014 VLDB 0.00017363171
503 Towards a Unified Architecture for in-RDBMS Analytics 2012 SIGMOD 0.00017195428
521 Learning Linear Regression Models over Factorized Joins 2016 SIGMOD 0.00016923519
731 Learning Generalized Linear Models Over Normalized Data 2015 SIGMOD 0.00014400356
849 Aggregation and Ordering in Factorised Databases 2013 VLDB 0.00013498306
851 Scaling Factorization Machines to Relational Data 2013 VLDB 0.00013453278
907 Data Blocks: Hybrid OLTP and OLAP on Compressed Storage using both Vectorization and Compilation 2016 SIGMOD 0.00013157412
1,045 RIOT: I/O-Efficient Numerical Computing without SQL 2009 CIDR 0.00012327118
1,445 An Architecture for Compiling UDF-centric Workflows 2015 VLDB 0.00010628379
1,614 Compressed Linear Algebra for Large-Scale Machine Learning 2016 VLDB 0.00010067153
1,744 How to Architect a Query Compiler 2016 SIGMOD 9.7332903e-05
2,249 Cumulon: Optimizing Statistical Data Analysis in the Cloud 2013 SIGMOD 8.7544468e-05
3,505 Fast Queries Over Heterogeneous Data Through Engine Customization 2016 VLDB 7.2474175e-05
4,117 Resource Elasticity for Large-Scale Machine Learning 2015 SIGMOD 6.7929814e-05
4,417 Estimating Compilation Time of a Query Optimizer 2003 SIGMOD 6.6064397e-05
6,403 Profiling R on a Contemporary Processor 2015 VLDB 5.7950827e-05
7,780 DBToaster: Agile Views in a Dynamic Data Management System 2011 CIDR 5.4528185e-05
7,787 Measuring and Optimizing Distributed Array Programs 2016 VLDB 5.4511698e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 282 Accelerating Machine Learning Inference with Probabilistic Predicates 2018 SIGMOD
2 5,110 Steering Query Optimizers: A Practical Take on Big Data Workloads 2021 SIGMOD
3 8,690 Galley: Modern Query Optimization for Sparse Tensor Programs 2025 SIGMOD
4 10,459 EncoderForge: Generating Efficient SQL for Encoders in Machine Learning Inference Pipelines 2026 SIGMOD
5 2,201 Enabling and Optimizing Non-linear Feature Interactions in Factorized Linear Algebra 2019 SIGMOD
6 8,806 Towards A Polyglot Framework for Factorized ML 2021 VLDB
7 2,266 An Intermediate Representation for Optimizing Machine Learning Pipelines 2019 VLDB
8 6,293 Incorporating Super-Operators in Big-Data Query Optimizers 2020 VLDB
9 3,103 On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML 2018 VLDB
10 4,975 SPORES: Sum-Product Optimization via Relational Equality Saturation for Large Scale Linear Algebra 2020 VLDB