High-Performance Query Processing with NVMe Arrays: Spilling without Killing Performance

Summary: Adaptive materialization turns in-memory hash operators into spill-friendly OOM operators without sacrificing in-memory speed. Self-regulating compression optimizes spilling throughput on NVMe arrays, enabling Spilly to match in-memory performance while handling large out-of-memory workloads. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 6986
Venue: SIGMOD
Year: 2024
Pagerank: 4.1945683e-05
Overall Rank: 10,989 | 23.56%
DOI: 10.1145/3698813

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

Incoming Citations (Sorted by Pagerank)

Showing 4 of 4 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
9,980	Declarative Memory Services	2026	CIDR	4.1945683e-05
10,255	How to Write to SSDs	2026	VLDB	4.1945683e-05
10,714	Towards Designing Future-Proof Data Processing Systems	2025	VLDB	4.1945683e-05
10,852	CloudGlide: Deconstructing the Landscape of Cloud-Based Analytics	2025	VLDB	4.1945683e-05

Outgoing Citations (Sorted by Pagerank)

Showing 43 of 43 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
9	Implementation Techniques For Main Memory Database Systems	1984	SIGMOD	0.0014279444
52	Database Architecture Optimized for the new Bottleneck: Memory Access	1999	VLDB	0.00066474881
71	How Good Are Query Optimizers, Really?	2016	VLDB	0.00059038975
80	Weaving Relations for Cache Performance	2001	VLDB	0.00055721729
86	The End of an Architectural Era (It's Time for a Complete Rewrite)	2007	VLDB	0.00052563276
124	DBMSs On A Modern Processor: Where Does Time Go?	1999	VLDB	0.00045103515
185	DuckDB: an Embeddable Analytical Database	2019	SIGMOD	0.00036538405
215	OLTP Through the Looking Glass, and What We Found There	2008	SIGMOD	0.0003354907
241	DB2 with BLU Acceleration: So Much More than Just a Column Store	2013	VLDB	0.00031420034
289	High-Performance Concurrency Control Mechanisms for Main-Memory Databases	2012	VLDB	0.00028938503
418	Morsel-Driven Parallelism: A NUMA-Aware Query Evaluation Framework for the Many-Core Age	2014	SIGMOD	0.00023729211
540	Design and Evaluation of Main Memory Hash Join Algorithms for Multi-core CPUs	2011	SIGMOD	0.0002063443
550	Hash-Partitioned Join Method Using Dynamic Destaging Strategy	1988	VLDB	0.00020359891
714	Adaptive Aggregation on Chip Multiprocessors	2007	VLDB	0.00017730584
735	Umbra: A Disk-Based System with In-Memory Performance	2020	CIDR	0.00017452467
853	Everything You Always Wanted to Know About Compiled and Vectorized Queries But Were Afraid to Ask	2018	VLDB	0.00015940507
1,497	Accelerating Relational Databases by Leveraging Remote Memory and RDMA	2016	SIGMOD	0.00011685781
1,607	A Comprehensive Study of Main-Memory Partitioning and its Application to Large-Scale Comparison- and Radix-Sort	2014	SIGMOD	0.00011162682
1,653	Query Processing Techniques for Solid State Drives	2009	SIGMOD	0.00011003558
1,804	An Experimental Comparison of Thirteen Relational Equi-Joins in Main Memory	2016	SIGMOD	0.00010501185
1,900	Hash joins and hash teams in Microsoft SQL Server	1998	VLDB	0.000101645
2,742	Cache-Efficient Aggregation: Hashing Is Sorting	2015	SIGMOD	8.1906104e-05
2,772	Quickstep: A Data Platform Based on the Scaling-Up Approach	2018	VLDB	8.1401661e-05
3,365	Turbocharging DBMS Buffer Pool Using SSDs	2011	SIGMOD	7.1728897e-05
3,644	BtrBlocks: Efficient Columnar Compression for Data Lakes	2023	SIGMOD	6.8854928e-05
3,687	Exploiting Directly-Attached NVMe Arrays in DBMS	2020	CIDR	6.8417266e-05
3,721	To Partition, or Not to Partition, That is the Join Question in a Real System	2021	SIGMOD	6.8179379e-05
3,736	What Modern NVMe Storage Can Do, And How To Exploit It: High-Performance I/O for High-Performance Storage Engines	2023	VLDB	6.8057888e-05
3,882	Micro Adaptivity in Vectorwise	2013	SIGMOD	6.6690423e-05
3,980	Making Updates Disk-I/O Friendly Using SSDs	2013	VLDB	6.5664429e-05
4,262	Efficient Processing of Window Functions in Analytical SQL Queries	2015	VLDB	6.3117226e-05
4,717	Cloud Analytics Benchmark	2023	VLDB	5.9751539e-05
4,870	Exploiting Cloud Object Storage for High-Performance Analytics	2023	VLDB	5.8613885e-05
5,126	Data Management Over Flash Memory	2011	SIGMOD	5.6793656e-05
5,312	The Art of Latency Hiding in Modern Database Engines	2024	VLDB	5.5734224e-05
5,653	On the Surprising Difficulty of Simple Things: the Case of Radix Partitioning	2015	VLDB	5.3889513e-05
5,848	MaSM: Efficient Online Updates in Data Warehouses	2011	SIGMOD	5.3021155e-05
5,864	Redy: Remote Dynamic Memory Cache	2022	VLDB	5.2975079e-05
6,861	HetCache: Synergising NVMe Storage and GPU acceleration for Memory-Efficient Analytics	2023	CIDR	4.905263e-05
7,836	NOCAP: Near-Optimal Correlation-Aware Partitioning Joins	2023	SIGMOD	4.6380835e-05
8,023	Design Trade-offs for a Robust Dynamic Hybrid Hash Join	2022	VLDB	4.6035454e-05
9,895	The Need for a New I/O Model	2021	CIDR	4.2600049e-05
9,899	Accelerating Analytics with Dynamic In-Memory Expressions	2016	VLDB	4.2600049e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
4,945	SplinterDB and Maplets: Improving the Tradeoffs in Key-Value Store Compaction Policy	2023	SIGMOD	5.8157107e-05
3,305	Robust Query Processing in Co-Processor-accelerated Databases	2016	SIGMOD	7.2460965e-05
2,451	Write-limited sorts and joins for persistent memory	2014	VLDB	8.7856313e-05
7,693	Processing and Optimizing Main Memory Spatial-Keyword Queries	2016	VLDB	4.6759281e-05
8,047	Thrifty Query Execution via Incrementability	2020	SIGMOD	4.5983505e-05
5,049	Run-Time Operator State Spilling for Memory Intensive Long-Running Queries	2006	SIGMOD	5.7372423e-05
6,658	Scalable Querying of Nested Data	2021	VLDB	4.9711629e-05
6,304	Elastic Pipelining in an In-Memory Database Cluster	2016	SIGMOD	5.1210182e-05
6,648	Grizzly: Efficient Stream Processing Through Adaptive Query Compilation	2020	SIGMOD	4.9771723e-05
60	Efficiently Compiling Efficient Query Plans for Modern Hardware	2011	VLDB	0.00064439773