DBScholar

Back to papers

End-to-end Optimization of Machine Learning Prediction Queries

Summary: Raven unifies data processing and ML inference in one IR/graph to optimize prediction queries. Data-driven runtime selection and logical-to-physical transformations span CPU/GPU and ML/DNN backends, delivering up to 13x on Spark and 330x on SQL Server. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h7ceb362f37487f68
Venue
SIGMOD
Year
2022
Pagerank
8.1596229e-05
Overall Rank
2,662 | 82.11%
DOI
10.1145/3514221.3526141

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{park_sigmod22,
        title = {{End-to-end Optimization of Machine Learning Prediction Queries}},
        author = {Park, Kwanghyun and Saur, Karla and Banda, Dalitso and Sen, Rathijit and Interlandi, Matteo and Karanasos, Konstantinos},
        series = {{SIGMOD} '22},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3514221.3526141},
        url = {https://dl.acm.org/doi/10.1145/3514221.3526141},
        year = {2022}
}

Incoming Citations (Sorted by Pagerank)

Showing 25 of 25 citing papers.

Rank Citing Paper Year Venue Pagerank
5,272 InferDB: In-Database Machine Learning Inference Using Indexes 2024 VLDB 6.2010954e-05
5,776 The Tensor Data Platform: Towards an AI-centric Database System 2023 CIDR 5.9981216e-05
6,415 Containerized Execution of UDFs: An Experimental Evaluation 2022 VLDB 5.7926473e-05
6,742 Mitigating the Impedance Mismatch between Prediction Query Execution and Database Engine 2025 SIGMOD 5.6910432e-05
7,538 Automating and Optimizing Data-Centric What-If Analyses on Native Machine Learning Pipelines 2023 SIGMOD 5.4995874e-05
7,978 Biathlon: Harnessing Model Resilience for Accelerating ML Inference Pipelines 2024 VLDB 5.4136835e-05
8,230 Adda: Towards Efficient in-Database Feature Generation via LLM-based Agents 2025 SIGMOD 5.372368e-05
8,385 NeurDB: On the Design and Implementation of an AI-powered Autonomous Database 2025 CIDR 5.3420959e-05
8,682 Galley: Modern Query Optimization for Sparse Tensor Programs 2025 SIGMOD 5.2905577e-05
8,984 nsDB: Architecting the Next Generation Database by Integrating Neural and Symbolic Systems 2024 VLDB 5.2433452e-05
9,212 Powering In-Database Dynamic Model Slicing for Structured Data Analytics 2024 VLDB 5.2060505e-05
10,020 Share the Tensor Tea: How Databases can Leverage the Machine Learning Ecosystem 2022 VLDB 5.0943606e-05
10,043 The Image Calculator: 10x Faster Image-AI Inference by Replacing JPEG with Self-designing Storage Format 2024 SIGMOD 5.0921006e-05
10,435 DFLOP: A Data-driven Framework for Multimodal LLM Training Pipeline Optimization 2026 SIGMOD 4.9793485e-05
10,446 Eliminating Redundant Feature Tests in Decision Tree and Random Forest Inference on SQL Predicates 2026 SIGMOD 4.9793485e-05
10,448 EncoderForge: Generating Efficient SQL for Encoders in Machine Learning Inference Pipelines 2026 SIGMOD 4.9793485e-05
10,504 SPALM: A Sparsity-Pattern-Adaptive Library for Matrices 2026 SIGMOD 4.9793485e-05
10,582 NeurStore: Efficient In-database Deep Learning Model Management System 2026 SIGMOD 4.9793485e-05
10,608 MorphingDB: A Task-Centric AI-Native DBMS for Model Management and Inference 2026 SIGMOD 4.9793485e-05
10,653 InferF: Declarative Factorization of AI/ML Inferences over Joins 2026 SIGMOD 4.9793485e-05
10,798 NeurIDA: Dynamic Modeling for Effective In-Database Analytics 2026 VLDB 4.9793485e-05
10,876 ConRAD: Conformal Risk-Aware Neural Databases 2026 VLDB 4.9793485e-05
10,923 TQP++: Bridging ML Compilers and Analytical Query Processing on GPUs 2026 VLDB 4.9793485e-05
10,932 IMLane: Composable Framework for Efficient AI Function Execution in Database Engine 2026 VLDB 4.9793485e-05
11,786 Sniffer: A Novel Model Type Detection System against Machine-Learning-as-a-Service Platforms 2023 VLDB 4.9793485e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 32 of 32 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
23 Spark SQL: Relational Data Processing in Spark 2015 SIGMOD 0.00055406774
52 The Snowflake Elastic Data Warehouse 2016 SIGMOD 0.00041219077
105 The MADlib Analytics Library or MAD Skills, the SQL 2012 VLDB 0.00033638251
281 Accelerating Machine Learning Inference with Probabilistic Predicates 2018 SIGMOD 0.00022295232
352 On the Power of Magic 1987 PODS 0.00020223279
415 SystemML: Declarative Machine Learning on Spark 2016 VLDB 0.0001865959
459 Delta Lake: High-Performance ACID Table Storage over Cloud Object Stores 2020 VLDB 0.00017856221
503 Towards a Unified Architecture for in-RDBMS Analytics 2012 SIGMOD 0.00017202276
730 Learning Generalized Linear Models Over Normalized Data 2015 SIGMOD 0.00014406936
896 Froid: Optimization of Imperative Programs in a Relational Database 2018 VLDB 0.00013209291
1,255 Data Management in Machine Learning: Challenges, Techniques, and Systems 2017 SIGMOD 0.00011325762
1,790 POLARIS: The Distributed SQL Engine in Azure Synapse 2020 VLDB 9.6272006e-05
2,053 tf.data: A Machine Learning Data Processing Framework 2021 VLDB 9.1140407e-05
2,182 Extending Relational Query Processing with ML Inference 2020 CIDR 8.8982998e-05
2,207 Magpie: Python at Speed and Scale using Cloud Backends 2021 CIDR 8.8487039e-05
2,249 Evaluating End-to-End Optimization for Data Analytics Applications in Weld 2018 VLDB 8.7549752e-05
2,264 An Intermediate Representation for Optimizing Machine Learning Pipelines 2019 VLDB 8.7289107e-05
2,446 Azure Data Lake Store: A Hyperscale Distributed File Service for Big Data Analytics 2017 SIGMOD 8.4547121e-05
2,830 DB4ML – An In-Memory Database Kernel with Machine Learning Support 2020 SIGMOD 7.9619979e-05
3,073 Pushing Data-Induced Predicates Through Joins in Big-Data Clusters 2020 VLDB 7.6777283e-05
3,219 Jointly Optimizing Preprocessing and Inference for DNN-based Visual Analytics 2021 VLDB 7.5207996e-05
3,401 A Demonstration of Willump: A Statistically-Aware End-to-end Optimizer for Machine Learning Inference 2020 VLDB 7.332823e-05
3,683 Cloudy with High Chance of DBMS: A 10-year Prediction for Enterprise-Grade ML 2020 CIDR 7.1006425e-05
3,953 Tensors: An abstraction for general data processing 2021 VLDB 6.9027109e-05
4,095 Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches 2021 VLDB 6.8095767e-05
4,161 The Relational Data Borg is Learning 2020 VLDB 6.7700593e-05
4,182 Rafiki: Machine Learning as an Analytics Service System 2019 VLDB 6.755131e-05
4,974 SPORES: Sum-Product Optimization via Relational Equality Saturation for Large Scale Linear Algebra 2020 VLDB 6.3318399e-05
5,289 Tensor Relational Algebra for Distributed Machine Learning System Design 2021 VLDB 6.1940481e-05
6,323 Lightweight Inspection of Data Preprocessing in Native Machine Learning Pipelines 2021 CIDR 5.8138422e-05
6,998 Integration of Data Mining and Relational Databases 2000 VLDB 5.6253155e-05
8,593 Not Black-Box Anymore! Enabling Analytics-Aware Optimizations in Teradata Vantage 2021 VLDB 5.3068556e-05
Previous Page 1 / 1 Next

Semantically Similar Papers