The FastLanes Compression Layout: Decoding >100 Billion Integers per Second with Scalar Code

Summary: FastLanes redesigns LWC layouts with virtual-1024-bit interleaving and a unified transposed tuple order, exposing data parallelism across DICT, FOR, DELTA, and RLE. Scalar, auto-vectorizable code achieves >100B integer decodes/s across diverse CPUs. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: he83138df048f8c0f
Venue: VLDB
Year: 2023
Pagerank: 7.5589507e-05
Overall Rank: 3,182 | 78.62%
DOI: 10.14778/3598581.3598587
PDF: Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

1. Azim Afroozeh (Centrum Wiskunde & Informatica)
2. Peter Boncz (Centrum Wiskunde & Informatica)

BibTeX Citation

@article{afroozeh_vldb23,
        title = {{The FastLanes Compression Layout: Decoding >100 Billion Integers per Second with Scalar Code}},
        author = {Afroozeh, Azim and Boncz, Peter},
        journal = {PVLDB},
        series = {{VLDB} '23},
        volume = {16},
        number = {9},
        pages = {2132--2144},
        doi = {10.14778/3598581.3598587},
        url = {https://doi.org/10.14778/3598581.3598587},
        year = {2023}
}

Incoming Citations (Sorted by Pagerank)

Showing 22 of 22 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
2,929	ALP: Adaptive Lossless floating-Point Compression	2023	SIGMOD	7.838721e-05
3,810	An Empirical Evaluation of Columnar Storage Formats	2024	VLDB	7.0064171e-05
6,675	Composable Data Management: An Execution Overview	2024	VLDB	5.7114624e-05
7,811	PDX: A Data Layout for Vector Similarity Search	2025	SIGMOD	5.4476368e-05
8,280	Scaling GPU-Accelerated Databases beyond GPU Memory Size	2025	VLDB	5.3616863e-05
8,559	F3: The Open-Source Data File Format for the Future	2026	SIGMOD	5.3141911e-05
8,577	The FastLanes File Format	2025	VLDB	5.3107348e-05
9,494	Beyond Compression: A Comprehensive Evaluation of Lossless Floating-Point Compression	2025	VLDB	5.168414e-05
9,870	GPU Acceleration of SQL Analytics on Compressed Data	2026	VLDB	5.115241e-05
10,085	LiquidCache: Efficient Pushdown Caching for Cloud-Native Data Analytics	2025	VLDB	5.0806786e-05
10,232	Active Data Lakes: Regaining Physical Data Independence Without Losing Interoperability	2026	VLDB	5.0547568e-05
10,256	AnyBlox: A Framework for Self-Decoding Datasets	2025	VLDB	5.0495724e-05
10,482	Kangaroo: Efficient Lossless Floating-Point Compression via Dynamic Reference Selection	2026	SIGMOD	4.9769913e-05
10,484	L3: A GPU-Native Co-Designed Data Format for Learned Lossless Lightweight Compression	2026	SIGMOD	4.9769913e-05
10,680	Predictive Translation: High-Performance Buffer Management Without the Trade-Offs	2026	SIGMOD	4.9769913e-05
10,817	dpKernels: Harvesting DPU Compute Resources for Data-path Efficiency in Cloud Data Processing	2026	VLDB	4.9769913e-05
10,866	Interoperable ACID Transactions for Open Table Formats	2026	VLDB	4.9769913e-05
10,895	Accelerating String-Heavy Queries with LLM Token Tables	2026	VLDB	4.9769913e-05
10,914	ZipFlow: a Compiler-based Framework to Unleash Compressed Data Movement for Modern GPUs	2026	VLDB	4.9769913e-05
11,323	Improving Time Series Data Compression in Apache IoTDB	2025	VLDB	4.9769913e-05
11,351	Towards Designing Future-Proof Data Processing Systems	2025	VLDB	4.9769913e-05
11,470	Program your (custom) SIMD instruction set on FPGA in C++	2024	CIDR	4.9769913e-05

Outgoing Citations (Sorted by Pagerank)

Showing 16 of 16 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
14	MonetDB/X100: Hyper-Pipelining Query Execution	2005	CIDR	0.00064013679
61	Integrating Compression and Execution in Column-Oriented Database Systems	2006	SIGMOD	0.00039236924
219	SIMD-Scan: Ultra Fast in-Memory Table Scan using on-Chip Vector Processing Units	2009	VLDB	0.00024367137
287	Implementing Database Operations Using SIMD Instructions	2002	SIGMOD	0.00022001327
605	Everything You Always Wanted to Know About Compiled and Vectorized Queries But Were Afraid to Ask	2018	VLDB	0.00015640305
627	Rethinking SIMD Vectorization for In-Memory Databases	2015	SIGMOD	0.00015454197
873	BitWeaving: Fast Scans for Main Memory Data Processing	2013	SIGMOD	0.00013334067
907	Data Blocks: Hybrid OLTP and OLAP on Compressed Storage using both Vectorization and Compilation	2016	SIGMOD	0.00013157412
1,423	Procella: Unifying serving and analytical data at YouTube	2019	VLDB	0.00010715412
1,424	Velox: Meta's Unified Execution Engine	2022	VLDB	0.00010714183
1,718	ByteSlice: Pushing the Envelop of Main Memory Data Processing with a New Storage Layout	2015	SIGMOD	9.7983307e-05
1,770	How to Wring a Table Dry: Entropy Compression of Relations and Querying of Compressed Relations	2006	VLDB	9.6822825e-05
1,825	Data Management for Data Science: Towards Embedded Analytics	2020	CIDR	9.5558093e-05
3,657	Tile-based Lightweight Integer Compression in GPU	2022	SIGMOD	7.1227107e-05
6,987	Leveraging Compression in the Tableau Data Engine	2014	SIGMOD	5.6258961e-05
7,735	Hardware-Oblivious SIMD Parallelism for In-Memory Column-Stores	2020	CIDR	5.4632401e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	605	Everything You Always Wanted to Know About Compiled and Vectorized Queries But Were Afraid to Ask	2018	VLDB
2	10,910	Overlay Bitmap Encoding for Efficient Consumption of Apache Parquet Files	2026	VLDB
3	10,027	Towards Functional Decomposition of Storage Formats	2025	CIDR
4	219	SIMD-Scan: Ultra Fast in-Memory Table Scan using on-Chip Vector Processing Units	2009	VLDB
5	11,825	Runtime Encoding Execution in AnalyticDB: Efficient Query Executor for Cloud Database	2022	CIDR
6	1,984	How to Barter Bits for Chronons: Compression and Bandwidth Trade Offs for Database Scans	2007	SIGMOD
7	3,657	Tile-based Lightweight Integer Compression in GPU	2022	SIGMOD
8	6,395	Selection Pushdown in Column Stores using Bit Manipulation Instructions	2023	SIGMOD
9	9,870	GPU Acceleration of SQL Analytics on Compressed Data	2026	VLDB
10	8,577	The FastLanes File Format	2025	VLDB