DBScholar

Back to papers

Pipelining in Multi-Query Optimization

Summary: Introduce a general model for pipelined multi-query optimization and a necessary and sufficient condition to decide schedule validity under finite buffer constraints. Prove NP-hardness of finding minimum-cost valid schedules, propose a greedy heuristic, and show TPC-D performance gains. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID
1223
Venue
PODS
Year
2001
Pagerank
0.00013807229
Overall Rank
822 | 94.37%
DOI
10.1145/375551.375561

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{dalvi_pods01,
        address = {New York, NY, USA},
        series = {{PODS} '01},
        title = {{Pipelining in Multi-Query Optimization}},
        url = {https://dl.acm.org/doi/10.1145/375551.375561},
        doi = {10.1145/375551.375561},
        booktitle = {Proceedings of the {ACM} {SIGMOD} Symposium on {Principles} of {Database} {Systems}},
        publisher = {Association for Computing Machinery},
        author = {Dalvi, Nilesh N. and Sanghai, Sumit K and Roy, Prasan and Sudarshan, S.},
        year = {2001}
}

Incoming Citations (Sorted by Pagerank)

Showing 26 of 26 citing papers.

Rank Citing Paper Year Venue Pagerank
111 TelegraphCQ: Continuous Dataflow Processing for an Uncertain World 2003 CIDR 0.00032990214
383 QPipe: A Simultaneously Pipelined Relational Query Engine 2005 SIGMOD 0.00019520728
670 SharedDB: Killing One Thousand Queries With One Stone 2012 VLDB 0.00015157572
761 Cooperative Scans: Dynamic Bandwidth Sharing in a DBMS 2007 VLDB 0.00014254351
2,276 Shared Workload Optimization 2014 VLDB 8.8196376e-05
2,686 On Improving User Response Times in Tableau 2015 SIGMOD 8.25822e-05
3,268 Efficient and Provable Multi-Query Optimization 2017 PODS 7.5810998e-05
3,319 Multiple Query Optimization on the D-Wave 2X Adiabatic Quantum Computer 2016 VLDB 7.5236413e-05
3,426 Exact Cardinality Query Optimization for Optimizer Testing 2009 VLDB 7.4218997e-05
3,913 An Approach to Optimize Data Processing in Business Processes 2007 VLDB 7.0230514e-05
3,978 The Case for Precision Sharing 2004 VLDB 6.9771565e-05
4,330 Sharing Data and Work Across Concurrent Analytical Queries 2013 VLDB 6.7563122e-05
4,441 Optimization of Continuous Queries with Shared Expensive Filters 2007 PODS 6.7021508e-05
4,508 To Share or Not to Share? 2007 VLDB 6.6561159e-05
5,470 Efficient Computation of Multiple Group By Queries 2005 SIGMOD 6.2070458e-05
5,701 Lemo: A Cache-Enhanced Learned Optimizer for Concurrent Queries 2023 SIGMOD 6.1167049e-05
5,979 QoX-Driven ETL Design: Reducing the Cost of ETL Consulting Engagements 2009 SIGMOD 6.0212043e-05
6,309 Materialization and Reuse Optimizations for Production Data Science Pipelines 2022 SIGMOD 5.9189554e-05
6,901 Near-Optimal Algorithms for Shared Filter Evaluation in Data Stream Systems 2008 SIGMOD 5.742719e-05
7,213 Scalable Multi-Query Execution using Reinforcement Learning 2021 SIGMOD 5.670422e-05
7,656 Nautilus: An Optimized System for Deep Transfer Learning over Evolving Training Datasets 2022 SIGMOD 5.5740571e-05
7,891 Adaptive Optimizations of Recursive Queries in Teradata 2012 SIGMOD 5.5211516e-05
8,864 Pipemizer: An Optimizer for Analytics Data Pipelines 2022 VLDB 5.355022e-05
9,299 Optimizing Complex Queries with Multiple Relation Instances 2008 SIGMOD 5.2895587e-05
10,078 Request Window: an Approach to Improve Throughput of RDBMS-based Data Integration System by Utilizing Data Sharing Across Concurrent Distributed Queries 2007 VLDB 5.1603976e-05
11,207 Pasta: A Cost-Based Optimizer for Generating Pipelining Schedules for Dataflow DAGs 2024 SIGMOD 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 5 of 5 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
128 Efficient and Extensible Algorithms for Multi Query Optimization 2000 SIGMOD 0.0003072825
830 Exploiting Inter-Operation Parallelism in XPRS 1992 SIGMOD 0.00013761367
942 Materialized View Selection for Multidimensional Datasets 1998 VLDB 0.00013076262
1,375 Anatomy of a Modular Multiple Query Optimizer 1988 VLDB 0.00010977145
2,068 Scheduling Problems in Parallel Query Optimization 1995 PODS 9.2310451e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 2,104 Optimization of Multi-Way Join Queries for Parallel Execution 1991 VLDB
2 6,018 Dependency-Aware Reordering for Parallelizing Query Optimization in Multi-Core CPUs 2009 SIGMOD
3 3,250 On Optimal Processor Allocation To Support Pipelined Hash Joins 1993 SIGMOD
4 3,268 Efficient and Provable Multi-Query Optimization 2017 PODS
5 2,337 Multi-dimensional Resource Scheduling for Parallel Queries 1996 SIGMOD
6 1,763 Dynamic Pipeline Scheduling for Improving Interactive Query Performance 2001 VLDB
7 6,255 Elastic Pipelining in an In-Memory Database Cluster 2016 SIGMOD
8 2,068 Scheduling Problems in Parallel Query Optimization 1995 PODS
9 2,131 Optimization Algorithms for Exploiting the Parallelism-Communication Tradeoff in Pipelined Parallelism 1994 VLDB
10 9,612 Memory Efficient Scheduling of Query Pipeline Execution 2022 CIDR