The FastLanes Compression Layout: Decoding >100 Billion Integers per Second with Scalar Code

Summary: FastLanes redesigns LWC layouts with virtual-1024-bit interleaving and a unified transposed tuple order, exposing data parallelism across DICT, FOR, DELTA, and RLE. Scalar, auto-vectorizable code achieves >100B integer decodes/s across diverse CPUs. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: 13253
Venue: VLDB
Year: 2023
Pagerank: 7.2774889e-05
Overall Rank: 3,592 | 75.36%
DOI: 10.14778/3598581.3598587

Incoming Non-self Citations Over Time

Authors

1. Azim Afroozeh (Centrum Wiskunde & Informatica)
2. Peter Boncz (Centrum Wiskunde & Informatica)

BibTeX Citation

@article{afroozeh_vldb23,
        title = {{The FastLanes Compression Layout: Decoding >100 Billion Integers per Second with Scalar Code}},
        author = {Afroozeh, Azim and Boncz, Peter},
        journal = {PVLDB},
        series = {{VLDB} '23},
        volume = {16},
        number = {9},
        pages = {2132--2144},
        doi = {10.14778/3598581.3598587},
        url = {https://doi.org/10.14778/3598581.3598587},
        year = {2023}
}

Incoming Citations (Sorted by Pagerank)

Showing 18 of 18 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
3,269	ALP: Adaptive Lossless floating-Point Compression	2023	SIGMOD	7.5809516e-05
3,877	An Empirical Evaluation of Columnar Storage Formats	2024	VLDB	7.0532293e-05
7,720	PDX: A Data Layout for Vector Similarity Search	2025	SIGMOD	5.559007e-05
8,862	Composable Data Management: An Execution Overview	2024	VLDB	5.3554382e-05
9,038	The FastLanes File Format	2025	VLDB	5.3270943e-05
9,277	F3: The Open-Source Data File Format for the Future	2026	SIGMOD	5.2937431e-05
10,057	AnyBlox: A Framework for Self-Decoding Datasets	2025	VLDB	5.1664022e-05
10,258	Kangaroo: Efficient Lossless Floating-Point Compression via Dynamic Reference Selection	2026	SIGMOD	5.093636e-05
10,260	L3: A GPU-Native Co-Designed Data Format for Learned Lossless Lightweight Compression	2026	SIGMOD	5.093636e-05
10,482	Predictive Translation: High-Performance Buffer Management Without the Trade-Offs	2026	SIGMOD	5.093636e-05
10,536	Active Data Lakes: Regaining Physical Data Independence Without Losing Interoperability	2026	VLDB	5.093636e-05
10,580	GPU Acceleration of SQL Analytics on Compressed Data	2026	VLDB	5.093636e-05
10,923	Improving Time Series Data Compression in Apache IoTDB	2025	VLDB	5.093636e-05
10,957	Towards Designing Future-Proof Data Processing Systems	2025	VLDB	5.093636e-05
10,980	Beyond Compression: A Comprehensive Evaluation of Lossless Floating-Point Compression	2025	VLDB	5.093636e-05
10,985	Scaling GPU-Accelerated Databases beyond GPU Memory Size	2025	VLDB	5.093636e-05
11,078	LiquidCache: Efficient Pushdown Caching for Cloud-Native Data Analytics	2025	VLDB	5.093636e-05
11,116	Program your (custom) SIMD instruction set on FPGA in C++	2024	CIDR	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 16 of 16 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
14	MonetDB/X100: Hyper-Pipelining Query Execution	2005	CIDR	0.0006312782
60	Integrating Compression and Execution in Column-Oriented Database Systems	2006	SIGMOD	0.0003955489
216	SIMD-Scan: Ultra Fast in-Memory Table Scan using on-Chip Vector Processing Units	2009	VLDB	0.00024498128
293	Implementing Database Operations Using SIMD Instructions	2002	SIGMOD	0.00022259273
634	Rethinking SIMD Vectorization for In-Memory Databases	2015	SIGMOD	0.00015533814
649	Everything You Always Wanted to Know About Compiled and Vectorized Queries But Were Afraid to Ask	2018	VLDB	0.00015320656
870	BitWeaving: Fast Scans for Main Memory Data Processing	2013	SIGMOD	0.0001350293
941	Data Blocks: Hybrid OLTP and OLAP on Compressed Storage using both Vectorization and Compilation	2016	SIGMOD	0.00013078348
1,494	Procella: Unifying serving and analytical data at YouTube	2019	VLDB	0.00010577585
1,748	How to Wring a Table Dry: Entropy Compression of Relations and Querying of Compressed Relations	2006	VLDB	9.8480684e-05
1,757	Velox: Meta's Unified Execution Engine	2022	VLDB	9.8166984e-05
1,761	ByteSlice: Pushing the Envelop of Main Memory Data Processing with a New Storage Layout	2015	SIGMOD	9.8154969e-05
2,000	Data Management for Data Science: Towards Embedded Analytics	2020	CIDR	9.3336258e-05
4,144	Tile-based Lightweight Integer Compression in GPU	2022	SIGMOD	6.8744592e-05
6,918	Leveraging Compression in the Tableau Data Engine	2014	SIGMOD	5.7392935e-05
7,666	Hardware-Oblivious SIMD Parallelism for In-Memory Column-Stores	2020	CIDR	5.57179e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	10,056	Rethinking the Encoding of Integers for Scans on Skewed Data	2023	SIGMOD
2	649	Everything You Always Wanted to Know About Compiled and Vectorized Queries But Were Afraid to Ask	2018	VLDB
3	9,836	Towards Functional Decomposition of Storage Formats	2025	CIDR
4	216	SIMD-Scan: Ultra Fast in-Memory Table Scan using on-Chip Vector Processing Units	2009	VLDB
5	11,510	Runtime Encoding Execution in AnalyticDB: Efficient Query Executor for Cloud Database	2022	CIDR
6	1,950	How to Barter Bits for Chronons: Compression and Bandwidth Trade Offs for Database Scans	2007	SIGMOD
7	4,144	Tile-based Lightweight Integer Compression in GPU	2022	SIGMOD
8	7,139	Selection Pushdown in Column Stores using Bit Manipulation Instructions	2023	SIGMOD
9	10,580	GPU Acceleration of SQL Analytics on Compressed Data	2026	VLDB
10	9,038	The FastLanes File Format	2025	VLDB