QPipe: A Simultaneously Pipelined Relational Query Engine

Summary: On-demand simultaneous pipelining (OSP) enables proactive sharing of operator work across concurrent queries. QPipe, an operator-centric engine with per-operator micro-engines, uses OSP for cross-query data sharing, yielding ~2x speedup on TPC-H. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 3652
Venue: SIGMOD
Year: 2005
Pagerank: 0.00019697147
Overall Rank: 379 | 97.37%
DOI: -

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 50 of 58 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
232	Morsel-Driven Parallelism: A NUMA-Aware Query Evaluation Framework for the Many-Core Age	2014	SIGMOD	0.00024053681
252	Data-Oriented Transaction Execution	2010	VLDB	0.00023458831
257	Database Cracking	2007	CIDR	0.00023290946
335	Column-Stores vs. Row-Stores: How Different Are They Really?	2008	SIGMOD	0.00020950127
620	Performance Tradeoffs in Read-Optimized Databases	2006	VLDB	0.0001578795
672	SharedDB: Killing One Thousand Queries With One Stone	2012	VLDB	0.00015237733
693	Main-Memory Scan Sharing For Multi-Core CPUs	2008	VLDB	0.00015070559
719	Database Architecture Evolution: Mammals Flourished long before Dinosaurs became Extinct	2009	VLDB	0.00014778429
746	Cooperative Scans: Dynamic Bandwidth Sharing in a DBMS	2007	VLDB	0.00014451073
783	MRShare: Sharing Across Multiple Queries in MapReduce	2010	VLDB	0.00014090608
927	Data Processing on FPGAs	2009	VLDB	0.0001321383
1,007	A Scalable, Predictable Join Operator for Highly Concurrent Data Warehouses	2009	VLDB	0.00012770178
1,009	The DataPath System: A Data-Centric Analytic Processing Engine for Large Data Warehouses	2010	SIGMOD	0.00012763646
1,417	Towards Scalable Dataframe Systems	2020	VLDB	0.00010936782
1,863	Predictable Performance for Unpredictable Workloads	2009	VLDB	9.6827833e-05
2,260	Shared Workload Optimization	2014	VLDB	8.9230446e-05
2,639	Database Servers on Chip Multiprocessors: Limitations and Opportunities	2007	CIDR	8.3832688e-05
2,672	Robust Query Processing in Co-Processor-accelerated Databases	2016	SIGMOD	8.3332071e-05
2,674	Major Technical Advancements in Apache Hive	2014	SIGMOD	8.3291726e-05
2,801	GPL: A GPU-based Pipelined Query Processing Engine	2016	SIGMOD	8.1704574e-05
3,222	Scheduling Shared Scans of Large Data Files	2008	VLDB	7.6944971e-05
3,553	Access Path Selection in Main-Memory Optimized Data Systems: Should I Scan or Should I Probe?	2017	SIGMOD	7.3775219e-05
4,015	Deployment of Query Plans on Multicores	2015	VLDB	7.0264117e-05
4,103	Optimizing I/O for Big Array Analytics	2012	VLDB	6.962475e-05
4,105	QuickFOIL: Scalable Inductive Logic Programming	2015	VLDB	6.9601255e-05
4,267	Sharing Data and Work Across Concurrent Analytical Queries	2013	VLDB	6.8603605e-05
4,439	To Share or Not to Share?	2007	VLDB	6.7592478e-05
4,580	MQJoin: Efficient Shared Execution of Main-Memory Joins	2016	VLDB	6.6916493e-05
4,917	A Top-Down Approach to Achieving Performance Predictability in Database Systems	2017	SIGMOD	6.5113533e-05
5,011	Holistic Indexing in Main-memory Column-stores	2015	SIGMOD	6.4695774e-05
5,537	Cache-Efficient Fork-Processing Patterns on Large Graphs	2021	SIGMOD	6.2441752e-05
5,641	OLTPShare: The Case for Sharing in OLTP Workloads	2018	VLDB	6.2028058e-05
6,380	Revisiting Reuse in Main Memory Database Systems	2017	SIGMOD	5.9592606e-05
6,403	AStream: Ad-hoc Shared Stream Processing	2019	SIGMOD	5.952729e-05
6,460	A Morsel-Driven Query Execution Engine for Heterogeneous Multi-Cores	2019	VLDB	5.9293379e-05
6,571	CrocodileDB: Efficient Database Execution through Intelligent Deferment	2020	CIDR	5.8935326e-05
6,578	From Cooperative Scans to Predictive Buffer Management	2012	VLDB	5.8902212e-05
6,586	Cheap Data Analytics using Cold Storage Devices	2016	VLDB	5.8884379e-05
6,733	GPU-accelerated data management under the test of time	2020	CIDR	5.8456577e-05
6,779	Increasing Buffer-Locality for Multiple Index Based Scans through Intelligent Placement and Index Scan Speed Control	2007	VLDB	5.8336353e-05
6,888	Lemo: A Cache-Enhanced Learned Optimizer for Concurrent Queries	2023	SIGMOD	5.8154414e-05
7,142	Scalable Multi-Query Execution using Reinforcement Learning	2021	SIGMOD	5.7474895e-05
7,442	Resource-efficient Shared Query Execution via Exploiting Time Slackness	2021	SIGMOD	5.6790236e-05
7,969	Operational Analytics Data Management Systems	2016	VLDB	5.5713051e-05
8,176	ADDICT: Advanced Instruction Chasing for Transactions	2014	VLDB	5.5395318e-05
8,479	Accelerating Pathology Image Data Cross-Comparison on CPU-GPU Hybrid Systems	2012	VLDB	5.4881802e-05
8,774	TensorSocket: Shared Data Loading for Deep Learning Training	2026	SIGMOD	5.4311509e-05
9,148	How to Stop Under-Utilization and Love Multicores	2014	SIGMOD	5.3732086e-05
9,191	Optimizing Complex Queries with Multiple Relation Instances	2008	SIGMOD	5.3708383e-05
9,450	Online Optimization and Fair Costing for Dynamic Data Sharing in a Cloud Data Market	2014	SIGMOD	5.3308016e-05

Outgoing Citations (Sorted by Pagerank)

Showing 20 of 20 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
22	NiagaraCQ: A Scalable Continuous Query System for Internet Databases	2000	SIGMOD	0.00055779316
39	Efficiently Updating Materialized Views	1986	SIGMOD	0.00047924678
85	Automated Selection of Materialized Views and Indexes for SQL Databases	2000	VLDB	0.00035865404
127	Efficient and Extensible Algorithms for Multi Query Optimization	2000	SIGMOD	0.00031128834
131	An Evaluation of Buffer Management Strategies for Relational Database Systems	1985	VLDB	0.00030605909
147	Common Expression Analysis in Database Applications	1982	SIGMOD	0.00029440496
150	Efficient Mid-Query Re-Optimization of Sub-Optimal Query Execution Plans	1998	SIGMOD	0.00029370827
190	Continuously Adaptive Continuous Queries over Streams	2002	SIGMOD	0.0002632985
241	The LRU-K Page Replacement Algorithm For Database Disk Buffering	1993	SIGMOD	0.00023899276
291	Shoring Up Persistent Applications	1994	SIGMOD	0.00022263373
402	Semantic Data Caching and Replacement	1996	VLDB	0.00019242112
666	2Q: A Low Overhead High Performance Buffer Management Replacement Algorithm	1994	VLDB	0.00015297495
796	Pipelining in Multi-Query Optimization	2001	PODS	0.0001399653
809	Streaming Queries over Streaming Data	2002	VLDB	0.00013943032
918	Buffering Database Operations for Enhanced Instruction Cache Performance	2004	SIGMOD	0.00013277892
1,922	Red Brick Warehouse: A Read-Mostly RDBMS for Open SMP Platforms	1994	SIGMOD	9.5655921e-05
2,377	A Case for Staged Database Systems	2003	CIDR	8.7432767e-05
2,485	The Case for Enhanced Abstract Data Types	1997	VLDB	8.5872713e-05
6,277	Green Query Optimization: Taming Query Optimization Overheads through Plan Recycling	2004	VLDB	5.9933469e-05
7,611	The Next Database Revolution	2004	SIGMOD	5.6415044e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
1,576	Pipelined Query Processing in Coprocessor Environments	2018	SIGMOD	0.00010368954
9,577	Reactive and Proactive Sharing Across Concurrent Analytical Queries	2014	SIGMOD	5.3127526e-05
1,730	Dynamic Pipeline Scheduling for Improving Interactive Query Performance	2001	VLDB	9.9762336e-05
11,155	Pipeline Group Optimization on Disaggregated Systems	2023	CIDR	5.1725247e-05
2,090	Optimization Algorithms for Exploiting the Parallelism-Communication Tradeoff in Pipelined Parallelism	1994	VLDB	9.2547212e-05
9,463	Memory Efficient Scheduling of Query Pipeline Execution	2022	CIDR	5.3261493e-05
1,007	A Scalable, Predictable Join Operator for Highly Concurrent Data Warehouses	2009	VLDB	0.00012770178
6,164	Elastic Pipelining in an In-Memory Database Cluster	2016	SIGMOD	6.0304568e-05
4,267	Sharing Data and Work Across Concurrent Analytical Queries	2013	VLDB	6.8603605e-05
796	Pipelining in Multi-Query Optimization	2001	PODS	0.0001399653