DBScholar

Back to papers

SPOOF: Sum-Product Optimization and Operator Fusion for Large-Scale Machine Learning

Summary: Introduces Spoof, an automatic framework that unifies algebraic simplification (sum-product) rewrites and operator fusion/codegen for ML DAGs to exploit linear-algebra properties and sparsity. Produces fused kernels with performance close to hand-tuned code and modest compile overhead. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID
h50407d76bef9dd62
Venue
CIDR
Year
2017
Pagerank
7.4173693e-05
Overall Rank
3,330 | 77.62%
DOI
-

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{elgamal_cidr17,
        address = {Amsterdam, Netherlands},
        series = {{CIDR} '17},
        title = {{SPOOF: Sum-Product Optimization and Operator Fusion for Large-Scale Machine Learning}},
        booktitle = {Proceedings of the {Conference} on {Innovative} {Data} {Systems} {Research}},
        author = {Elgamal, Tarek and Luo, Shangyu and Boehm, Matthias and Evfimievski, Alexandre V. and Tatikonda, Shirish and Reinwald, Berthold and Sen, Prithviraj},
        year = {2017}
}

Incoming Citations (Sorted by Pagerank)

Showing 15 of 15 citing papers.

Rank Citing Paper Year Venue Pagerank
315 Worst-Case Optimal Join Algorithms: Techniques, Results, and Open Problems 2018 PODS 0.00021246
1,255 Data Management in Machine Learning: Challenges, Techniques, and Systems 2017 SIGMOD 0.00011325762
1,256 Towards Linear Algebra over Normalized Data 2017 VLDB 0.00011314687
2,199 Enabling and Optimizing Non-linear Feature Interactions in Factorized Linear Algebra 2019 SIGMOD 8.8750296e-05
2,264 An Intermediate Representation for Optimizing Machine Learning Pipelines 2019 VLDB 8.7289107e-05
2,663 A Layered Aggregate Engine for Analytics Workloads 2019 SIGMOD 8.1581558e-05
2,975 In-Database Learning with Sparse Tensors 2018 PODS 7.7907759e-05
3,101 On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML 2018 VLDB 7.649219e-05
4,330 MNC: Structure-Exploiting Sparsity Estimation for Matrix Expressions 2019 SIGMOD 6.6595681e-05
4,334 LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems 2021 SIGMOD 6.6569314e-05
4,974 SPORES: Sum-Product Optimization via Relational Equality Saturation for Large Scale Linear Algebra 2020 VLDB 6.3318399e-05
6,662 UPLIFT: Parallelization Strategies for Feature Transformations in Machine Learning Workloads 2022 VLDB 5.7171651e-05
8,521 FuseME: Distributed Matrix Computation Engine based on Cuboid-based Fused Operator and Plan Generation 2022 SIGMOD 5.3238144e-05
10,832 ReSequel: Robust LLM-assisted Query Rewriting and Optimization using Templatization and Sampling 2026 VLDB 4.9793485e-05
11,846 Redundancy Elimination in Distributed Matrix Computation 2022 SIGMOD 4.9793485e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 23 of 23 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
21 Efficiently Compiling Efficient Query Plans for Modern Hardware 2011 VLDB 0.00056855599
73 Including Group-By in Query Optimization 1994 VLDB 0.00037522101
213 Eager Aggregation and Lazy Aggregation 1995 VLDB 0.00024759805
357 FAQ: Questions Asked Frequently 2016 PODS 0.00020020639
415 SystemML: Declarative Machine Learning on Spark 2016 VLDB 0.0001865959
495 Building Efficient Query Engines in a High-Level Language 2014 VLDB 0.00017370758
503 Towards a Unified Architecture for in-RDBMS Analytics 2012 SIGMOD 0.00017202276
521 Learning Linear Regression Models over Factorized Joins 2016 SIGMOD 0.00016929744
730 Learning Generalized Linear Models Over Normalized Data 2015 SIGMOD 0.00014406936
849 Aggregation and Ordering in Factorised Databases 2013 VLDB 0.00013504405
851 Scaling Factorization Machines to Relational Data 2013 VLDB 0.00013457975
906 Data Blocks: Hybrid OLTP and OLAP on Compressed Storage using both Vectorization and Compilation 2016 SIGMOD 0.00013160654
1,044 RIOT: I/O-Efficient Numerical Computing without SQL 2009 CIDR 0.00012332595
1,444 An Architecture for Compiling UDF-centric Workflows 2015 VLDB 0.0001063181
1,614 Compressed Linear Algebra for Large-Scale Machine Learning 2016 VLDB 0.00010071891
1,742 How to Architect a Query Compiler 2016 SIGMOD 9.7378418e-05
2,247 Cumulon: Optimizing Statistical Data Analysis in the Cloud 2013 SIGMOD 8.7585767e-05
3,505 Fast Queries Over Heterogeneous Data Through Engine Customization 2016 VLDB 7.2508161e-05
4,116 Resource Elasticity for Large-Scale Machine Learning 2015 SIGMOD 6.7961306e-05
4,415 Estimating Compilation Time of a Query Optimizer 2003 SIGMOD 6.6094699e-05
6,401 Profiling R on a Contemporary Processor 2015 VLDB 5.7978253e-05
7,771 DBToaster: Agile Views in a Dynamic Data Management System 2011 CIDR 5.4553987e-05
7,789 Measuring and Optimizing Distributed Array Programs 2016 VLDB 5.4521754e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 5,110 Steering Query Optimizers: A Practical Take on Big Data Workloads 2021 SIGMOD
2 281 Accelerating Machine Learning Inference with Probabilistic Predicates 2018 SIGMOD
3 8,682 Galley: Modern Query Optimization for Sparse Tensor Programs 2025 SIGMOD
4 10,448 EncoderForge: Generating Efficient SQL for Encoders in Machine Learning Inference Pipelines 2026 SIGMOD
5 2,199 Enabling and Optimizing Non-linear Feature Interactions in Factorized Linear Algebra 2019 SIGMOD
6 8,798 Towards A Polyglot Framework for Factorized ML 2021 VLDB
7 2,264 An Intermediate Representation for Optimizing Machine Learning Pipelines 2019 VLDB
8 6,290 Incorporating Super-Operators in Big-Data Query Optimizers 2020 VLDB
9 3,101 On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML 2018 VLDB
10 4,974 SPORES: Sum-Product Optimization via Relational Equality Saturation for Large Scale Linear Algebra 2020 VLDB