Morsel-Driven Parallelism: A NUMA-Aware Query Evaluation Framework for the Many-Core Age

Summary: Introduces morsel-driven parallelism: NUMA-aware, fine-grained tasks that schedule small data morsels to run complete operator pipelines, bypassing plan-driven load balance. Dispatcher maps morsels to NUMA-local workers, enabling elastic parallelism and achieving >30x speedup on 32 cores for TPC-H/SSB. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 4878
Venue: SIGMOD
Year: 2014
Pagerank: 0.00023729211
Overall Rank: 418 | 97.10%
DOI: 10.1145/2588555.2610507

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 50 of 123 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
735	Umbra: A Disk-Based System with In-Memory Performance	2020	CIDR	0.00017452467
853	Everything You Always Wanted to Know About Compiled and Vectorized Queries But Were Afraid to Ask	2018	VLDB	0.00015940507
958	Rethinking SIMD Vectorization for In-Memory Databases	2015	SIGMOD	0.00015045316
1,016	Memory-Efficient Hash Joins	2015	VLDB	0.00014638492
1,105	Cardinality Estimation Done Right: Index-Based Join Sampling	2017	CIDR	0.00013990395
1,263	Data Blocks: Hybrid OLTP and OLAP on Compressed Storage using both Vectorization and Compilation	2016	SIGMOD	0.00012982857
1,284	Amazon Redshift Re-invented	2022	SIGMOD	0.00012837822
1,361	The End of Slow Networks: It's Time for a Redesign	2016	VLDB	0.00012379741
1,409	High-Speed Query Processing over High-Speed Networks	2016	VLDB	0.00012132768
1,507	BatchDB: Efficient Isolated Execution of Hybrid OLTP+OLAP Workloads for Interactive Applications	2017	SIGMOD	0.00011617967
1,864	Relaxed Operator Fusion for In-Memory Databases: Making Compilation, Vectorization, and Prefetching Work Together At Last	2018	VLDB	0.00010280966
2,275	Adopting Worst-Case Optimal Joins in Relational Database Systems	2020	VLDB	9.1262202e-05
2,287	Pipelined Query Processing in Coprocessor Environments	2018	SIGMOD	9.0972606e-05
2,383	How to Architect a Query Compiler	2016	SIGMOD	8.9294108e-05
2,568	Towards Cost-Optimal Query Processing in the Cloud	2021	VLDB	8.5239227e-05
2,651	HetExchange: Encapsulating heterogeneous CPU-GPU parallelism in JIT compiled engines	2019	VLDB	8.3694317e-05
2,772	Quickstep: A Data Platform Based on the Scaling-Up Approach	2018	VLDB	8.1401661e-05
2,838	How to Architect a Query Compiler, Revisited	2018	SIGMOD	8.0408472e-05
2,916	Quantifying TPC-H Choke Points and Their Optimizations	2020	VLDB	7.9068048e-05
2,962	Kuzu* Graph Database Management System	2023	CIDR	7.8101752e-05
3,099	DB4ML – An In-Memory Database Kernel with Machine Learning Support	2020	SIGMOD	7.5642871e-05
3,254	Query Processing on Tensor Computation Runtimes	2022	VLDB	7.3161051e-05
3,305	Robust Query Processing in Co-Processor-accelerated Databases	2016	SIGMOD	7.2460965e-05
3,327	Pump Up the Volume: Processing Large Data on GPUs with Fast Interconnects	2020	SIGMOD	7.2205738e-05
3,465	GPL: A GPU-based Pipelined Query Processing Engine	2016	SIGMOD	7.0695873e-05
3,721	To Partition, or Not to Partition, That is the Join Question in a Real System	2021	SIGMOD	6.8179379e-05
4,161	Access Path Selection in Main-Memory Optimized Data Systems: Should I Scan or Should I Probe?	2017	SIGMOD	6.3938006e-05
4,262	Efficient Processing of Window Functions in Analytical SQL Queries	2015	VLDB	6.3117226e-05
4,282	Scaling Up Concurrent Main-Memory Column-Store Scans: Towards Adaptive NUMA-aware Data and Task Placement	2015	VLDB	6.293052e-05
4,363	Hardware-conscious Query Processing in GPU-accelerated Analytical Engines	2019	CIDR	6.2552614e-05
4,488	Analyzing Efficient Stream Processing on Modern Hardware	2019	VLDB	6.145117e-05
4,495	ClickHouse - Lightning Fast Analytics for Everyone	2024	VLDB	6.1410277e-05
4,610	Deployment of Query Plans on Multicores	2015	VLDB	6.0516573e-05
4,688	Alibaba Hologres: A Cloud-Native Service for Hybrid Serving/Analytical Processing	2020	VLDB	5.9980609e-05
4,694	Scalable Reservoir Sampling on Many-Core CPUs	2019	SIGMOD	5.9944898e-05
4,870	Exploiting Cloud Object Storage for High-Performance Analytics	2023	VLDB	5.8613885e-05
4,924	User-Defined Operators: Efficiently Integrating Custom Algorithms into Modern Databases	2022	VLDB	5.822682e-05
4,948	Designing an Open Framework for Query Optimization and Compilation	2022	VLDB	5.8116879e-05
4,999	Adaptive Work Placement for Query Processing on Heterogeneous Computing Resources	2017	VLDB	5.7752801e-05
5,109	Adaptive NUMA-aware data placement and task scheduling for analytical workloads in main-memory column-stores	2017	VLDB	5.6908086e-05
5,193	LightSaber: Efficient Window Aggregation on Multi-core Processors	2020	SIGMOD	5.6371049e-05
5,197	Data-Parallel Query Processing on Non-Uniform Data	2020	VLDB	5.6347409e-05
5,212	Self-Tuning Query Scheduling for Analytical Workloads	2021	SIGMOD	5.6262923e-05
5,530	Permutable Compiled Queries: Dynamically Adapting Compiled Queries without Recompiling	2021	VLDB	5.4554282e-05
5,657	BriskStream: Scaling Data Stream Processing on Shared-Memory Multicore Architectures	2019	SIGMOD	5.3864606e-05
5,671	LSched: A Workload-Aware Learned Query Scheduler for Analytical Database Systems	2022	SIGMOD	5.3803919e-05
5,723	Evolution of a Compiling Query Engine	2021	VLDB	5.3522361e-05
5,748	MxTasks: How to Make Efficient Synchronization and Prefetching Easy	2021	SIGMOD	5.341943e-05
5,864	Redy: Remote Dynamic Memory Cache	2022	VLDB	5.2975079e-05
5,877	Taming Subgraph Isomorphism for RDF Query Processing	2015	VLDB	5.2916612e-05

Outgoing Citations (Sorted by Pagerank)

Showing 16 of 16 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
35	MonetDB/X100: Hyper-Pipelining Query Execution	2005	CIDR	0.00076197749
60	Efficiently Compiling Efficient Query Plans for Modern Hardware	2011	VLDB	0.00064439773
113	Encapsulation of Parallelism in the Volcano Query Processing System	1990	SIGMOD	0.00046764513
241	DB2 with BLU Acceleration: So Much More than Just a Column Store	2013	VLDB	0.00031420034
351	Sort vs. Hash Revisited: Fast Join Implementation on Modern Multi-Core CPUs	2009	VLDB	0.0002636504
404	Multi-Core, Main-Memory Joins: Sort vs. Hash Revisited	2014	VLDB	0.00024143076
515	QPipe: A Simultaneously Pipelined Relational Query Engine	2005	SIGMOD	0.00021214633
540	Design and Evaluation of Main Memory Hash Join Algorithms for Multi-core CPUs	2011	SIGMOD	0.0002063443
585	Massively Parallel Sort-Merge Joins in Main Memory Multi-Core Database Systems	2012	VLDB	0.00019706145
940	SharedDB: Killing One Thousand Queries With One Stone	2012	VLDB	0.00015173166
1,223	Enhancements to SQL Server Column Stores	2013	SIGMOD	0.00013207641
1,287	Hardware-Oblivious Parallelism for In-Memory Column-Stores	2013	VLDB	0.00012820443
1,543	NUMA-aware algorithms: the case of data shuffling	2013	CIDR	0.0001145318
1,694	How Soccer Players Would do Stream Joins	2011	SIGMOD	0.00010893764
2,445	OLTP on Hardware Islands	2012	VLDB	8.8057827e-05
3,021	Adaptive and Big Data Scale Parallel Execution in Oracle	2013	VLDB	7.6991391e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
2,459	Multi-dimensional Resource Scheduling for Parallel Queries	1996	SIGMOD	8.7676516e-05
1,287	Hardware-Oblivious Parallelism for In-Memory Column-Stores	2013	VLDB	0.00012820443
6,304	Elastic Pipelining in an In-Memory Database Cluster	2016	SIGMOD	5.1210182e-05
6,337	Parallelizing Extensible Query Optimizers	2009	SIGMOD	5.1053757e-05
1,409	High-Speed Query Processing over High-Speed Networks	2016	VLDB	0.00012132768
2,287	Pipelined Query Processing in Coprocessor Environments	2018	SIGMOD	9.0972606e-05
10,745	Robust Recursive Query Parallelism in Graph Database Management Systems	2025	VLDB	4.1945683e-05
585	Massively Parallel Sort-Merge Joins in Main Memory Multi-Core Database Systems	2012	VLDB	0.00019706145
5,109	Adaptive NUMA-aware data placement and task scheduling for analytical workloads in main-memory column-stores	2017	VLDB	5.6908086e-05
6,964	A Morsel-Driven Query Execution Engine for Heterogeneous Multi-Cores	2019	VLDB	4.8815971e-05