High-Performance Query Processing with NVMe Arrays: Spilling without Killing Performance

Summary: Adaptive materialization turns in-memory hash operators into spill-friendly OOM operators without sacrificing in-memory speed. Self-regulating compression optimizes spilling throughput on NVMe arrays, enabling Spilly to match in-memory performance while handling large out-of-memory workloads. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 6987
Venue: SIGMOD
Year: 2024
Pagerank: 4.1905499e-05
Overall Rank: 10,992 | 23.61%
DOI: 10.1145/3698813

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

Incoming Citations (Sorted by Pagerank)

Showing 4 of 4 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
9,979	Declarative Memory Services	2026	CIDR	4.1905499e-05
10,255	How to Write to SSDs	2026	VLDB	4.1905499e-05
10,721	Towards Designing Future-Proof Data Processing Systems	2025	VLDB	4.1905499e-05
10,856	CloudGlide: Deconstructing the Landscape of Cloud-Based Analytics	2025	VLDB	4.1905499e-05

Outgoing Citations (Sorted by Pagerank)

Showing 43 of 43 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
9	Implementation Techniques For Main Memory Database Systems	1984	SIGMOD	0.001426258
52	Database Architecture Optimized for the new Bottleneck: Memory Access	1999	VLDB	0.00066322421
71	How Good Are Query Optimizers, Really?	2016	VLDB	0.00059446482
80	Weaving Relations for Cache Performance	2001	VLDB	0.00055735291
88	The End of an Architectural Era (It's Time for a Complete Rewrite)	2007	VLDB	0.0005262025
124	DBMSs On A Modern Processor: Where Does Time Go?	1999	VLDB	0.0004501099
185	DuckDB: an Embeddable Analytical Database	2019	SIGMOD	0.00036529607
215	OLTP Through the Looking Glass, and What We Found There	2008	SIGMOD	0.00033609709
241	DB2 with BLU Acceleration: So Much More than Just a Column Store	2013	VLDB	0.00031314629
286	High-Performance Concurrency Control Mechanisms for Main-Memory Databases	2012	VLDB	0.0002894802
417	Morsel-Driven Parallelism: A NUMA-Aware Query Evaluation Framework for the Many-Core Age	2014	SIGMOD	0.00023734582
538	Design and Evaluation of Main Memory Hash Join Algorithms for Multi-core CPUs	2011	SIGMOD	0.00020632609
549	Hash-Partitioned Join Method Using Dynamic Destaging Strategy	1988	VLDB	0.00020348047
711	Adaptive Aggregation on Chip Multiprocessors	2007	VLDB	0.00017724982
729	Umbra: A Disk-Based System with In-Memory Performance	2020	CIDR	0.00017448059
848	Everything You Always Wanted to Know About Compiled and Vectorized Queries But Were Afraid to Ask	2018	VLDB	0.00015933538
1,474	Accelerating Relational Databases by Leveraging Remote Memory and RDMA	2016	SIGMOD	0.00011781099
1,610	A Comprehensive Study of Main-Memory Partitioning and its Application to Large-Scale Comparison- and Radix-Sort	2014	SIGMOD	0.00011155922
1,635	Query Processing Techniques for Solid State Drives	2009	SIGMOD	0.00011059682
1,800	An Experimental Comparison of Thirteen Relational Equi-Joins in Main Memory	2016	SIGMOD	0.00010494121
1,902	Hash joins and hash teams in Microsoft SQL Server	1998	VLDB	0.0001015225
2,741	Cache-Efficient Aggregation: Hashing Is Sorting	2015	SIGMOD	8.1977375e-05
2,777	Quickstep: A Data Platform Based on the Scaling-Up Approach	2018	VLDB	8.1346418e-05
3,362	Turbocharging DBMS Buffer Pool Using SSDs	2011	SIGMOD	7.1681058e-05
3,642	BtrBlocks: Efficient Columnar Compression for Data Lakes	2023	SIGMOD	6.8876984e-05
3,682	Exploiting Directly-Attached NVMe Arrays in DBMS	2020	CIDR	6.8429686e-05
3,719	To Partition, or Not to Partition, That is the Join Question in a Real System	2021	SIGMOD	6.8141176e-05
3,724	What Modern NVMe Storage Can Do, And How To Exploit It: High-Performance I/O for High-Performance Storage Engines	2023	VLDB	6.8121422e-05
3,881	Micro Adaptivity in Vectorwise	2013	SIGMOD	6.6638918e-05
3,979	Making Updates Disk-I/O Friendly Using SSDs	2013	VLDB	6.5641036e-05
4,257	Efficient Processing of Window Functions in Analytical SQL Queries	2015	VLDB	6.3050642e-05
4,681	Cloud Analytics Benchmark	2023	VLDB	5.9953512e-05
4,873	Exploiting Cloud Object Storage for High-Performance Analytics	2023	VLDB	5.8557568e-05
5,060	The Art of Latency Hiding in Modern Database Engines	2024	VLDB	5.7175345e-05
5,126	Data Management Over Flash Memory	2011	SIGMOD	5.6739907e-05
5,256	Redy: Remote Dynamic Memory Cache	2022	VLDB	5.5990529e-05
5,664	On the Surprising Difficulty of Simple Things: the Case of Radix Partitioning	2015	VLDB	5.3838575e-05
5,848	MaSM: Efficient Online Updates in Data Warehouses	2011	SIGMOD	5.3023051e-05
6,861	HetCache: Synergising NVMe Storage and GPU acceleration for Memory-Efficient Analytics	2023	CIDR	4.9005561e-05
7,842	NOCAP: Near-Optimal Correlation-Aware Partitioning Joins	2023	SIGMOD	4.6336361e-05
8,024	Design Trade-offs for a Robust Dynamic Hybrid Hash Join	2022	VLDB	4.5993455e-05
9,894	The Need for a New I/O Model	2021	CIDR	4.2559233e-05
9,898	Accelerating Analytics with Dynamic In-Memory Expressions	2016	VLDB	4.2559233e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
4,948	SplinterDB and Maplets: Improving the Tradeoffs in Key-Value Store Compaction Policy	2023	SIGMOD	5.810122e-05
3,307	Robust Query Processing in Co-Processor-accelerated Databases	2016	SIGMOD	7.2391191e-05
2,257	Write-limited sorts and joins for persistent memory	2014	VLDB	9.1808674e-05
7,693	Processing and Optimizing Main Memory Spatial-Keyword Queries	2016	VLDB	4.6714423e-05
8,049	Thrifty Query Execution via Incrementability	2020	SIGMOD	4.5939412e-05
6,661	Scalable Querying of Nested Data	2021	VLDB	4.9663934e-05
5,047	Run-Time Operator State Spilling for Memory Intensive Long-Running Queries	2006	SIGMOD	5.7321615e-05
6,301	Elastic Pipelining in an In-Memory Database Cluster	2016	SIGMOD	5.1172165e-05
6,649	Grizzly: Efficient Stream Processing Through Adaptive Query Compilation	2020	SIGMOD	4.9724735e-05
59	Efficiently Compiling Efficient Query Plans for Modern Hardware	2011	VLDB	0.0006445664