Rethinking SIMD Vectorization for In-Memory Databases

Summary: Novel SIMD vectorized operators for in-memory DBs using gathers/scatters (selections, hashes, partitioning, sorting, joins). On MIC Xeon Phi and mainstream CPUs, up to 10x faster than prior work; highlights algorithmic and power-efficiency implications across simple vs. complex cores. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h9c8cc932ac55b758
Venue: SIGMOD
Year: 2015
Pagerank: 0.00015430074
Overall Rank: 627 | 95.80%
DOI: 10.1145/2723372.2747645

Incoming Non-self Citations Over Time

Authors

1. Orestis Polychroniou (Columbia University)
2. Arun Raghavan (Oracle)
3. Kenneth A. Ross (Columbia University)

BibTeX Citation

@inproceedings{polychroniou_sigmod15,
        title = {{Rethinking SIMD Vectorization for In-Memory Databases}},
        author = {Polychroniou, Orestis and Raghavan, Arun and Ross, Kenneth A.},
        series = {{SIGMOD} '15},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/2723372.2747645},
        url = {https://dl.acm.org/doi/10.1145/2723372.2747645},
        year = {2015}
}

Incoming Citations (Sorted by Pagerank)

Showing 50 of 52 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
894	Data Blocks: Hybrid OLTP and OLAP on Compressed Storage using both Vectorization and Compilation	2016	SIGMOD	0.00013179915
1,228	A Study of the Fundamental Performance Characteristics of GPUs and CPUs for Database Analytics	2020	SIGMOD	0.00011425748
1,269	An Experimental Comparison of Thirteen Relational Equi-Joins in Main Memory	2016	SIGMOD	0.00011236561
1,350	Relaxed Operator Fusion for In-Memory Databases: Making Compilation, Vectorization, and Prefetching Work Together At Last	2018	VLDB	0.00010934877
1,387	Procella: Unifying serving and analytical data at YouTube	2019	VLDB	0.0001080904
1,475	Voodoo - A Vector Algebra for Portable Database Performance on Modern Hardware	2016	VLDB	0.00010525713
1,488	Photon: A Fast Query Engine for Lakehouse Systems	2022	SIGMOD	0.00010487094
1,856	Morton Filters: Faster, Space-Efficient Cuckoo Filters via Biasing, Compression, and Decoupled Logical Sparsity	2018	VLDB	9.4802321e-05
1,981	Decomposed Bounded Floats for Fast Compression and Queries	2021	VLDB	9.2505963e-05
2,464	Query Processing on Tensor Computation Runtimes	2022	VLDB	8.4081954e-05
2,808	GPL: A GPU-based Pipelined Query Processing Engine	2016	SIGMOD	7.962315e-05
2,827	To Partition, or Not to Partition, That is the Join Question in a Real System	2021	SIGMOD	7.9486247e-05
2,910	ClickHouse - Lightning Fast Analytics for Everyone	2024	VLDB	7.8621757e-05
2,965	Column Sketches: A Scan Accelerator for Rapid and Robust Predicate Evaluation	2018	SIGMOD	7.7894987e-05
3,063	The FastLanes Compression Layout: Decoding >100 Billion Integers per Second with Scalar Code	2023	VLDB	7.6806166e-05
3,606	Access Path Selection in Main-Memory Optimized Data Systems: Should I Scan or Should I Probe?	2017	SIGMOD	7.1528863e-05
3,622	Triton Join: Efficiently Scaling to a Large Join State on GPUs with Fast Interconnects	2022	SIGMOD	7.1350619e-05
3,719	CoroBase: Coroutine-Oriented Main-Memory Database Engine	2021	VLDB	7.0525094e-05
3,775	Hardware-conscious Query Processing in GPU-accelerated Analytical Engines	2019	CIDR	7.0079979e-05
4,591	Accelerating Raw Data Analysis with the ACCORDA Software and Hardware Architecture	2019	VLDB	6.5021605e-05
4,958	FPGA-based Data Partitioning	2017	SIGMOD	6.3254925e-05
5,564	Charting the Design Space of Query Execution using VOILA	2021	VLDB	6.0660209e-05
5,603	Database Processing-in-Memory: An Experimental Study	2020	VLDB	6.0518498e-05
5,632	BinDex: A Two-Layered Index for Fast and Robust Scans	2020	SIGMOD	6.0402517e-05
6,228	Data Partitioning for In-Memory Systems: Myths, Challenges, and Opportunities	2019	CIDR	5.8261473e-05
6,297	Rethinking MIMD-SIMD Interplay for Analytical Query Processing in In-Memory Database Engines	2025	CIDR	5.802701e-05
6,400	Selection Pushdown in Column Stores using Bit Manipulation Instructions	2023	SIGMOD	5.7811299e-05
6,425	MorphStore: Analytical Query Engine with a Holistic Compression-Enabled Processing Model	2020	VLDB	5.7716425e-05
6,688	Composable Data Management: An Execution Overview	2024	VLDB	5.6925768e-05
6,711	BSX : Subgraph Matching with Batch Backtracking Search	2025	SIGMOD	5.6854796e-05
7,439	Is Perfect Hashing Practical for OLAP Systems?	2024	CIDR	5.5122587e-05
7,470	Modularis: Modular Relational Analytics over Heterogeneous Distributed Platforms	2021	VLDB	5.5032592e-05
7,492	Fast Multi-Column Sorting in Main-Memory Column-Stores	2016	SIGMOD	5.4981253e-05
7,731	Hardware-Oblivious SIMD Parallelism for In-Memory Column-Stores	2020	CIDR	5.4500769e-05
7,822	Analyzing Vectorized Hash Tables Across CPU Architectures	2023	VLDB	5.4304761e-05
8,007	Scaling GPU-Accelerated Databases beyond GPU Memory Size	2025	VLDB	5.3916546e-05
8,111	Stackless Processing of Streamed Trees	2021	PODS	5.3739121e-05
8,390	Interleaved Multi-Vectorizing	2020	VLDB	5.325009e-05
8,560	Cabin: a Compressed Adaptive Binned Scan Index	2024	SIGMOD	5.3014368e-05
8,701	Adaptive Code Generation for Data-Intensive Analytics	2021	VLDB	5.2714222e-05
9,145	Efficiently Joining Large Relations on Multi-GPU Systems	2025	VLDB	5.2067758e-05
9,192	Automating Vectorized Distributed Graph Computation	2024	SIGMOD	5.1967502e-05
9,249	Chasing Similarity: Distribution-aware Aggregation Scheduling	2019	VLDB	5.1860134e-05
10,025	BIPie: Fast Selection and Aggregation on Encoded Data using Operator Specialization	2018	SIGMOD	5.0818547e-05
10,339	Data Chunk Compaction in Vectorized Execution	2025	SIGMOD	5.0210286e-05
10,341	Simple (yet Efficient) Function Authoring for Vectorized Engines	2024	VLDB	5.0210286e-05
10,727	LiveBin: A Localized and Version-Aware Binned Scan Index	2026	SIGMOD	4.9605343e-05
10,985	Reaching the Pinnacle of TPC-DS: Co-design of Architecture, Executor, and Storage in TDSQL	2026	VLDB	4.9605343e-05
11,453	GraphAr: An Efficient Storage Scheme for Graph Data in Data Lakes	2025	VLDB	4.9605343e-05
11,522	Program your (custom) SIMD instruction set on FPGA in C++	2024	CIDR	4.9605343e-05

Outgoing Citations (Sorted by Pagerank)

Showing 21 of 21 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
12	C-Store: A Column-oriented DBMS	2005	VLDB	0.00068985264
14	MonetDB/X100: Hyper-Pipelining Query Execution	2005	CIDR	0.00063972112
21	Efficiently Compiling Efficient Query Plans for Modern Hardware	2011	VLDB	0.00056737487
27	Database Architecture Optimized for the New Bottleneck: Memory Access	1999	VLDB	0.0005146739
161	DB2 with BLU Acceleration: So Much More than Just a Column Store	2013	VLDB	0.00027629724
212	Sort vs. Hash Revisited: Fast Join Implementation on Modern Multi-Core CPUs	2009	VLDB	0.00024786576
215	Morsel-Driven Parallelism: A NUMA-Aware Query Evaluation Framework for the Many-Core Age	2014	SIGMOD	0.00024554257
218	SIMD-Scan: Ultra Fast in-Memory Table Scan using on-Chip Vector Processing Units	2009	VLDB	0.00024342426
250	Multi-Core, Main-Memory Joins: Sort vs. Hash Revisited	2014	VLDB	0.00023080446
280	FAST: Fast Architecture Sensitive Tree Search on Modern CPUs and GPUs	2010	SIGMOD	0.00022267903
289	Implementing Database Operations Using SIMD Instructions	2002	SIGMOD	0.00021955394
360	Design and Evaluation of Main Memory Hash Join Algorithms for Multi-core CPUs	2011	SIGMOD	0.00019959166
423	Massively Parallel Sort-Merge Joins in Main Memory Multi-Core Database Systems	2012	VLDB	0.00018450254
662	Fast Sort on CPUs and GPUs: A Case for Bandwidth Oblivious SIMD Sort	2010	SIGMOD	0.00014972958
722	Efficient Implementation of Sorting on Multi-Core SIMD CPU Architecture	2008	VLDB	0.00014470465
997	What happens during a Join? Dissecting CPU and Memory Optimization Effects	2000	VLDB	0.00012595178
1,119	A Comprehensive Study of Main-Memory Partitioning and its Application to Large-Scale Comparison- and Radix-Sort	2014	SIGMOD	0.00011927356
1,532	Column Imprints: A Secondary Index Structure	2013	SIGMOD	0.00010312002
3,441	Cache-Conscious Radix-Decluster Projections	2004	VLDB	7.2786711e-05
3,470	Improving Main Memory Hash Joins on Intel Xeon Phi Processors: An Experimental Approach	2015	VLDB	7.2606844e-05
9,159	Automatic Contention Detection and Amelioration for Data-Intensive Operations	2010	SIGMOD	5.204001e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	8,390	Interleaved Multi-Vectorizing	2020	VLDB
2	722	Efficient Implementation of Sorting on Multi-Core SIMD CPU Architecture	2008	VLDB
3	606	Everything You Always Wanted to Know About Compiled and Vectorized Queries But Were Afraid to Ask	2018	VLDB
4	7,822	Analyzing Vectorized Hash Tables Across CPU Architectures	2023	VLDB
5	5,603	Database Processing-in-Memory: An Experimental Study	2020	VLDB
6	218	SIMD-Scan: Ultra Fast in-Memory Table Scan using on-Chip Vector Processing Units	2009	VLDB
7	7,731	Hardware-Oblivious SIMD Parallelism for In-Memory Column-Stores	2020	CIDR
8	6,297	Rethinking MIMD-SIMD Interplay for Analytical Query Processing in In-Memory Database Engines	2025	CIDR
9	289	Implementing Database Operations Using SIMD Instructions	2002	SIGMOD
10	12,395	Vectorizing an In Situ Query Engine	2016	SIGMOD