Rethinking SIMD Vectorization for In-Memory Databases

Summary: Novel SIMD vectorized operators for in-memory DBs using gathers/scatters (selections, hashes, partitioning, sorting, joins). On MIC Xeon Phi and mainstream CPUs, up to 10x faster than prior work; highlights algorithmic and power-efficiency implications across simple vs. complex cores. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h9c8cc932ac55b758
Venue: SIGMOD
Year: 2015
Pagerank: 0.00015460957
Overall Rank: 627 | 95.79%
DOI: 10.1145/2723372.2747645

Incoming Non-self Citations Over Time

Authors

1. Orestis Polychroniou (Columbia University)
2. Arun Raghavan (Oracle)
3. Kenneth A. Ross (Columbia University)

BibTeX Citation

@inproceedings{polychroniou_sigmod15,
        title = {{Rethinking SIMD Vectorization for In-Memory Databases}},
        author = {Polychroniou, Orestis and Raghavan, Arun and Ross, Kenneth A.},
        series = {{SIGMOD} '15},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/2723372.2747645},
        url = {https://dl.acm.org/doi/10.1145/2723372.2747645},
        year = {2015}
}

Incoming Citations (Sorted by Pagerank)

Showing 50 of 52 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
906	Data Blocks: Hybrid OLTP and OLAP on Compressed Storage using both Vectorization and Compilation	2016	SIGMOD	0.00013160654
1,266	An Experimental Comparison of Thirteen Relational Equi-Joins in Main Memory	2016	SIGMOD	0.00011269175
1,268	A Study of the Fundamental Performance Characteristics of GPUs and CPUs for Database Analytics	2020	SIGMOD	0.0001126007
1,341	Relaxed Operator Fusion for In-Memory Databases: Making Compilation, Vectorization, and Prefetching Work Together At Last	2018	VLDB	0.00010968512
1,423	Procella: Unifying serving and analytical data at YouTube	2019	VLDB	0.00010719956
1,473	Voodoo - A Vector Algebra for Portable Database Performance on Modern Hardware	2016	VLDB	0.00010557973
1,487	Photon: A Fast Query Engine for Lakehouse Systems	2022	SIGMOD	0.00010521722
1,844	Morton Filters: Faster, Space-Efficient Cuckoo Filters via Biasing, Compression, and Decoupled Logical Sparsity	2018	VLDB	9.5159229e-05
1,973	Decomposed Bounded Floats for Fast Compression and Queries	2021	VLDB	9.2834606e-05
2,460	Query Processing on Tensor Computation Runtimes	2022	VLDB	8.4348335e-05
2,815	GPL: A GPU-based Pipelined Query Processing Engine	2016	SIGMOD	7.9777435e-05
2,818	To Partition, or Not to Partition, That is the Join Question in a Real System	2021	SIGMOD	7.9739791e-05
2,952	Column Sketches: A Scan Accelerator for Rapid and Robust Predicate Evaluation	2018	SIGMOD	7.8153507e-05
3,001	ClickHouse - Lightning Fast Analytics for Everyone	2024	VLDB	7.7667824e-05
3,181	The FastLanes Compression Layout: Decoding >100 Billion Integers per Second with Scalar Code	2023	VLDB	7.5625307e-05
3,599	Access Path Selection in Main-Memory Optimized Data Systems: Should I Scan or Should I Probe?	2017	SIGMOD	7.1773938e-05
3,626	Triton Join: Efficiently Scaling to a Large Join State on GPUs with Fast Interconnects	2022	SIGMOD	7.1524537e-05
3,709	CoroBase: Coroutine-Oriented Main-Memory Database Engine	2021	VLDB	7.0791362e-05
3,773	Hardware-conscious Query Processing in GPU-accelerated Analytical Engines	2019	CIDR	7.0294475e-05
4,573	Accelerating Raw Data Analysis with the ACCORDA Software and Hardware Architecture	2019	VLDB	6.5265033e-05
4,931	FPGA-based Data Partitioning	2017	SIGMOD	6.348544e-05
5,543	Charting the Design Space of Query Execution using VOILA	2021	VLDB	6.0889645e-05
5,598	Database Processing-in-Memory: An Experimental Study	2020	VLDB	6.0713144e-05
5,618	BinDex: A Two-Layered Index for Fast and Robust Scans	2020	SIGMOD	6.0630987e-05
6,213	Data Partitioning for In-Memory Systems: Myths, Challenges, and Opportunities	2019	CIDR	5.8479612e-05
6,279	Rethinking MIMD-SIMD Interplay for Analytical Query Processing in In-Memory Database Engines	2025	CIDR	5.8247094e-05
6,392	Selection Pushdown in Column Stores using Bit Manipulation Instructions	2023	SIGMOD	5.800848e-05
6,417	MorphStore: Analytical Query Engine with a Holistic Compression-Enabled Processing Model	2020	VLDB	5.791405e-05
6,670	Composable Data Management: An Execution Overview	2024	VLDB	5.7141674e-05
6,965	BSX : Subgraph Matching with Batch Backtracking Search	2025	SIGMOD	5.6328006e-05
7,416	Is Perfect Hashing Practical for OLAP Systems?	2024	CIDR	5.5331654e-05
7,451	Modularis: Modular Relational Analytics over Heterogeneous Distributed Platforms	2021	VLDB	5.5236802e-05
7,495	Fast Multi-Column Sorting in Main-Memory Column-Stores	2016	SIGMOD	5.5091753e-05
7,729	Hardware-Oblivious SIMD Parallelism for In-Memory Column-Stores	2020	CIDR	5.4657611e-05
7,814	Analyzing Vectorized Hash Tables Across CPU Architectures	2023	VLDB	5.4482093e-05
8,086	Stackless Processing of Streamed Trees	2021	PODS	5.3942942e-05
8,274	Scaling GPU-Accelerated Databases beyond GPU Memory Size	2025	VLDB	5.3642256e-05
8,380	Interleaved Multi-Vectorizing	2020	VLDB	5.3429493e-05
8,533	Cabin: a Compressed Adaptive Binned Scan Index	2024	SIGMOD	5.3215439e-05
8,673	Adaptive Code Generation for Data-Intensive Analytics	2021	VLDB	5.2913671e-05
9,215	Chasing Similarity: Distribution-aware Aggregation Scheduling	2019	VLDB	5.2056826e-05
9,429	Efficiently Joining Large Relations on Multi-GPU Systems	2025	VLDB	5.1786456e-05
9,981	BIPie: Fast Selection and Aggregation on Encoded Data using Operator Specialization	2018	SIGMOD	5.1011277e-05
10,262	Automating Vectorized Distributed Graph Computation	2024	SIGMOD	5.050482e-05
10,304	Data Chunk Compaction in Vectorized Execution	2025	SIGMOD	5.0400722e-05
10,306	Simple (yet Efficient) Function Authoring for Vectorized Engines	2024	VLDB	5.0400722e-05
10,655	LiveBin: A Localized and Version-Aware Binned Scan Index	2026	SIGMOD	4.9793485e-05
10,915	Reaching the Pinnacle of TPC-DS: Co-design of Architecture, Executor, and Storage in TDSQL	2026	VLDB	4.9793485e-05
11,394	GraphAr: An Efficient Storage Scheme for Graph Data in Data Lakes	2025	VLDB	4.9793485e-05
11,464	Program your (custom) SIMD instruction set on FPGA in C++	2024	CIDR	4.9793485e-05

Outgoing Citations (Sorted by Pagerank)

Showing 21 of 21 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
12	C-Store: A Column-oriented DBMS	2005	VLDB	0.00068998927
14	MonetDB/X100: Hyper-Pipelining Query Execution	2005	CIDR	0.00064031282
21	Efficiently Compiling Efficient Query Plans for Modern Hardware	2011	VLDB	0.00056855599
27	Database Architecture Optimized for the New Bottleneck: Memory Access	1999	VLDB	0.0005158963
163	DB2 with BLU Acceleration: So Much More than Just a Column Store	2013	VLDB	0.0002749118
210	Sort vs. Hash Revisited: Fast Join Implementation on Modern Multi-Core CPUs	2009	VLDB	0.00024851502
215	Morsel-Driven Parallelism: A NUMA-Aware Query Evaluation Framework for the Many-Core Age	2014	SIGMOD	0.00024598661
219	SIMD-Scan: Ultra Fast in-Memory Table Scan using on-Chip Vector Processing Units	2009	VLDB	0.00024363532
251	Multi-Core, Main-Memory Joins: Sort vs. Hash Revisited	2014	VLDB	0.00023143736
282	FAST: Fast Architecture Sensitive Tree Search on Modern CPUs and GPUs	2010	SIGMOD	0.00022264207
287	Implementing Database Operations Using SIMD Instructions	2002	SIGMOD	0.00021970198
361	Design and Evaluation of Main Memory Hash Join Algorithms for Multi-core CPUs	2011	SIGMOD	0.00020006406
423	Massively Parallel Sort-Merge Joins in Main Memory Multi-Core Database Systems	2012	VLDB	0.00018491327
661	Fast Sort on CPUs and GPUs: A Case for Bandwidth Oblivious SIMD Sort	2010	SIGMOD	0.00015003815
722	Efficient Implementation of Sorting on Multi-Core SIMD CPU Architecture	2008	VLDB	0.00014488003
998	What happens during a Join? Dissecting CPU and Memory Optimization Effects	2000	VLDB	0.00012630367
1,116	A Comprehensive Study of Main-Memory Partitioning and its Application to Large-Scale Comparison- and Radix-Sort	2014	SIGMOD	0.00011962096
1,529	Column Imprints: A Secondary Index Structure	2013	SIGMOD	0.00010348765
3,432	Cache-Conscious Radix-Decluster Projections	2004	VLDB	7.3040202e-05
3,459	Improving Main Memory Hash Joins on Intel Xeon Phi Processors: An Experimental Approach	2015	VLDB	7.2848113e-05
9,127	Automatic Contention Detection and Amelioration for Data-Intensive Operations	2010	SIGMOD	5.2237283e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	8,380	Interleaved Multi-Vectorizing	2020	VLDB
2	722	Efficient Implementation of Sorting on Multi-Core SIMD CPU Architecture	2008	VLDB
3	605	Everything You Always Wanted to Know About Compiled and Vectorized Queries But Were Afraid to Ask	2018	VLDB
4	7,814	Analyzing Vectorized Hash Tables Across CPU Architectures	2023	VLDB
5	5,598	Database Processing-in-Memory: An Experimental Study	2020	VLDB
6	219	SIMD-Scan: Ultra Fast in-Memory Table Scan using on-Chip Vector Processing Units	2009	VLDB
7	7,729	Hardware-Oblivious SIMD Parallelism for In-Memory Column-Stores	2020	CIDR
8	6,279	Rethinking MIMD-SIMD Interplay for Analytical Query Processing in In-Memory Database Engines	2025	CIDR
9	287	Implementing Database Operations Using SIMD Instructions	2002	SIGMOD
10	12,346	Vectorizing an In Situ Query Engine	2016	SIGMOD