QPipe: A Simultaneously Pipelined Relational Query Engine

Summary: On-demand simultaneous pipelining (OSP) enables proactive sharing of operator work across concurrent queries. QPipe, an operator-centric engine with per-operator micro-engines, uses OSP for cross-query data sharing, yielding ~2x speedup on TPC-H. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 3652
Venue: SIGMOD
Year: 2005
Pagerank: 0.00021209491
Overall Rank: 515 | 96.43%
DOI: -

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 50 of 58 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
336	Data-Oriented Transaction Execution	2010	VLDB	0.00027008897
407	Database Cracking	2007	CIDR	0.00023941779
417	Morsel-Driven Parallelism: A NUMA-Aware Query Evaluation Framework for the Many-Core Age	2014	SIGMOD	0.00023734582
496	Column-Stores vs. Row-Stores: How Different Are They Really?	2008	SIGMOD	0.00021705611
708	Performance Tradeoffs in Read-Optimized Databases	2006	VLDB	0.00017753572
754	Database Architecture Evolution: Mammals Flourished long before Dinosaurs became Extinct	2009	VLDB	0.00017093267
826	Main-Memory Scan Sharing For Multi-Core CPUs	2008	VLDB	0.00016161625
934	SharedDB: Killing One Thousand Queries With One Stone	2012	VLDB	0.00015201246
947	MRShare: Sharing Across Multiple Queries in MapReduce	2010	VLDB	0.00015112344
948	Data Processing on FPGAs	2009	VLDB	0.0001510759
1,027	Cooperative Scans: Dynamic Bandwidth Sharing in a DBMS	2007	VLDB	0.0001458537
1,296	The DataPath System: A Data-Centric Analytic Processing Engine for Large Data Warehouses	2010	SIGMOD	0.00012742585
1,427	Towards Scalable Dataframe Systems	2020	VLDB	0.00012033503
1,430	A Scalable, Predictable Join Operator for Highly Concurrent Data Warehouses	2009	VLDB	0.0001202506
2,372	Predictable Performance for Unpredictable Workloads	2009	VLDB	8.940791e-05
2,782	Database Servers on Chip Multiprocessors: Limitations and Opportunities	2007	CIDR	8.1278531e-05
2,928	Shared Workload Optimization	2014	VLDB	7.881485e-05
2,998	Major Technical Advancements in Apache Hive	2014	SIGMOD	7.7477264e-05
3,307	Robust Query Processing in Co-Processor-accelerated Databases	2016	SIGMOD	7.2391191e-05
3,349	QuickFOIL: Scalable Inductive Logic Programming	2015	VLDB	7.1889581e-05
3,471	GPL: A GPU-based Pipelined Query Processing Engine	2016	SIGMOD	7.0628019e-05
3,508	Scheduling Shared Scans of Large Data Files	2008	VLDB	7.0293743e-05
4,160	Access Path Selection in Main-Memory Optimized Data Systems: Should I Scan or Should I Probe?	2017	SIGMOD	6.3886736e-05
4,254	Optimizing I/O for Big Array Analytics	2012	VLDB	6.3084831e-05
4,609	Deployment of Query Plans on Multicores	2015	VLDB	6.0458679e-05
4,677	To Share or Not to Share?	2007	VLDB	5.9988869e-05
4,964	Sharing Data and Work Across Concurrent Analytical Queries	2013	VLDB	5.7974073e-05
5,298	MQJoin: Efficient Shared Execution of Main-Memory Joins	2016	VLDB	5.5762694e-05
5,378	Holistic Indexing in Main-memory Column-stores	2015	SIGMOD	5.5379945e-05
5,518	A Top-Down Approach to Achieving Performance Predictability in Database Systems	2017	SIGMOD	5.468383e-05
5,966	Cache-Efficient Fork-Processing Patterns on Large Graphs	2021	SIGMOD	5.2471834e-05
6,062	OLTPShare: The Case for Sharing in OLTP Workloads	2018	VLDB	5.2267464e-05
6,663	Cheap Data Analytics using Cold Storage Devices	2016	VLDB	4.9660535e-05
6,760	AStream: Ad-hoc Shared Stream Processing	2019	SIGMOD	4.9304882e-05
6,777	Revisiting Reuse in Main Memory Database Systems	2017	SIGMOD	4.9242249e-05
6,855	From Cooperative Scans to Predictive Buffer Management	2012	VLDB	4.9015429e-05
6,963	A Morsel-Driven Query Execution Engine for Heterogeneous Multi-Cores	2019	VLDB	4.8769125e-05
6,986	CrocodileDB: Efficient Database Execution through Intelligent Deferment	2020	CIDR	4.8672517e-05
7,082	Increasing Buffer-Locality for Multiple Index Based Scans through Intelligent Placement and Index Scan Speed Control	2007	VLDB	4.8333334e-05
7,209	GPU-accelerated data management under the test of time	2020	CIDR	4.7949787e-05
7,326	Lemo: A Cache-Enhanced Learned Optimizer for Concurrent Queries	2023	SIGMOD	4.7563708e-05
7,461	Scalable Multi-Query Execution using Reinforcement Learning	2021	SIGMOD	4.7193668e-05
7,699	Resource-efficient Shared Query Execution via Exploiting Time Slackness	2021	SIGMOD	4.6696504e-05
7,864	Operational Analytics Data Management Systems	2016	VLDB	4.6284093e-05
8,261	ADDICT: Advanced Instruction Chasing for Transactions	2014	VLDB	4.5420317e-05
8,352	Accelerating Pathology Image Data Cross-Comparison on CPU-GPU Hybrid Systems	2012	VLDB	4.5333481e-05
8,731	TensorSocket: Shared Data Loading for Deep Learning Training	2026	SIGMOD	4.4520434e-05
9,068	How to Stop Under-Utilization and Love Multicores	2014	SIGMOD	4.398897e-05
9,089	Optimizing Complex Queries with Multiple Relation Instances	2008	SIGMOD	4.3939805e-05
9,450	Online Optimization and Fair Costing for Dynamic Data Sharing in a Cloud Data Market	2014	SIGMOD	4.3367172e-05

Outgoing Citations (Sorted by Pagerank)

Showing 20 of 20 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
41	NiagaraCQ: A Scalable Continuous Query System for Internet Databases	2000	SIGMOD	0.00073944756
55	Efficiently Updating Materialized Views	1986	SIGMOD	0.00065687017
89	Common Expression Analysis in Database Applications	1982	SIGMOD	0.00052299473
128	An Evaluation of Buffer Management Strategies for Relational Database Systems	1985	VLDB	0.00044501642
160	Automated Selection of Materialized Views and Indexes for SQL Databases	2000	VLDB	0.00040053897
179	Efficient and Extensible Algorithms for Multi Query Optimization	2000	SIGMOD	0.00037637319
221	Efficient Mid-Query Re-Optimization of Sub-Optimal Query Execution Plans	1998	SIGMOD	0.00033182072
244	Continuously Adaptive Continuous Queries over Streams	2002	SIGMOD	0.00031037999
292	Shoring Up Persistent Applications	1994	SIGMOD	0.00028735468
306	The LRU-K Page Replacement Algorithm For Database Disk Buffering	1993	SIGMOD	0.00028255083
444	Semantic Data Caching and Replacement	1996	VLDB	0.0002303513
693	2Q: A Low Overhead High Performance Buffer Management Replacement Algorithm	1994	VLDB	0.00018045505
977	Pipelining in Multi-Query Optimization	2001	PODS	0.000148774
984	Streaming Queries over Streaming Data	2002	VLDB	0.00014840586
1,046	Buffering Database Operations for Enhanced Instruction Cache Performance	2004	SIGMOD	0.00014446882
2,104	Red Brick Warehouse: A Read-Mostly RDBMS for Open SMP Platforms	1994	SIGMOD	9.5341566e-05
2,329	A Case for Staged Database Systems	2003	CIDR	9.0237899e-05
2,675	The Case for Enhanced Abstract Data Types	1997	VLDB	8.3295149e-05
6,331	Green Query Optimization: Taming Query Optimization Overheads through Plan Recycling	2004	VLDB	5.1027649e-05
7,315	The Next Database Revolution	2004	SIGMOD	4.7594997e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
2,292	Pipelined Query Processing in Coprocessor Environments	2018	SIGMOD	9.0884645e-05
9,584	Reactive and Proactive Sharing Across Concurrent Analytical Queries	2014	SIGMOD	4.3178097e-05
1,917	Dynamic Pipeline Scheduling for Improving Interactive Query Performance	2001	VLDB	0.00010104953
11,155	Pipeline Group Optimization on Disaggregated Systems	2023	CIDR	4.1905499e-05
1,826	Optimization Algorithms for Exploiting the Parallelism-Communication Tradeoff in Pipelined Parallelism	1994	VLDB	0.00010392071
9,466	Memory Efficient Scheduling of Query Pipeline Execution	2022	CIDR	4.3314303e-05
1,430	A Scalable, Predictable Join Operator for Highly Concurrent Data Warehouses	2009	VLDB	0.0001202506
6,301	Elastic Pipelining in an In-Memory Database Cluster	2016	SIGMOD	5.1172165e-05
4,964	Sharing Data and Work Across Concurrent Analytical Queries	2013	VLDB	5.7974073e-05
977	Pipelining in Multi-Query Optimization	2001	PODS	0.000148774