The FastLanes Compression Layout: Decoding >100 Billion Integers per Second with Scalar Code

Summary: FastLanes redesigns LWC layouts with virtual-1024-bit interleaving and a unified transposed tuple order, exposing data parallelism across DICT, FOR, DELTA, and RLE. Scalar, auto-vectorizable code achieves >100B integer decodes/s across diverse CPUs. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: he83138df048f8c0f
Venue: VLDB
Year: 2023
Pagerank: 7.5625307e-05
Overall Rank: 3,181 | 78.62%
DOI: 10.14778/3598581.3598587

Incoming Non-self Citations Over Time

Authors

1. Azim Afroozeh (Centrum Wiskunde & Informatica)
2. Peter Boncz (Centrum Wiskunde & Informatica)

BibTeX Citation

@article{afroozeh_vldb23,
        title = {{The FastLanes Compression Layout: Decoding >100 Billion Integers per Second with Scalar Code}},
        author = {Afroozeh, Azim and Boncz, Peter},
        journal = {PVLDB},
        series = {{VLDB} '23},
        volume = {16},
        number = {9},
        pages = {2132--2144},
        doi = {10.14778/3598581.3598587},
        url = {https://doi.org/10.14778/3598581.3598587},
        year = {2023}
}

Incoming Citations (Sorted by Pagerank)

Showing 22 of 22 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
2,928	ALP: Adaptive Lossless floating-Point Compression	2023	SIGMOD	7.8424335e-05
3,808	An Empirical Evaluation of Columnar Storage Formats	2024	VLDB	7.0097354e-05
6,670	Composable Data Management: An Execution Overview	2024	VLDB	5.7141674e-05
7,804	PDX: A Data Layout for Vector Similarity Search	2025	SIGMOD	5.4502168e-05
8,274	Scaling GPU-Accelerated Databases beyond GPU Memory Size	2025	VLDB	5.3642256e-05
8,552	F3: The Open-Source Data File Format for the Future	2026	SIGMOD	5.316708e-05
8,569	The FastLanes File Format	2025	VLDB	5.3132501e-05
9,483	Beyond Compression: A Comprehensive Evaluation of Lossless Floating-Point Compression	2025	VLDB	5.1708619e-05
9,863	GPU Acceleration of SQL Analytics on Compressed Data	2026	VLDB	5.1176637e-05
10,080	LiquidCache: Efficient Pushdown Caching for Cloud-Native Data Analytics	2025	VLDB	5.0830849e-05
10,226	Active Data Lakes: Regaining Physical Data Independence Without Losing Interoperability	2026	VLDB	5.0571508e-05
10,250	AnyBlox: A Framework for Self-Decoding Datasets	2025	VLDB	5.051964e-05
10,471	Kangaroo: Efficient Lossless Floating-Point Compression via Dynamic Reference Selection	2026	SIGMOD	4.9793485e-05
10,473	L3: A GPU-Native Co-Designed Data Format for Learned Lossless Lightweight Compression	2026	SIGMOD	4.9793485e-05
10,669	Predictive Translation: High-Performance Buffer Management Without the Trade-Offs	2026	SIGMOD	4.9793485e-05
10,807	dpKernels: Harvesting DPU Compute Resources for Data-path Efficiency in Cloud Data Processing	2026	VLDB	4.9793485e-05
10,857	Interoperable ACID Transactions for Open Table Formats	2026	VLDB	4.9793485e-05
10,886	Accelerating String-Heavy Queries with LLM Token Tables	2026	VLDB	4.9793485e-05
10,905	ZipFlow: a Compiler-based Framework to Unleash Compressed Data Movement for Modern GPUs	2026	VLDB	4.9793485e-05
11,315	Improving Time Series Data Compression in Apache IoTDB	2025	VLDB	4.9793485e-05
11,344	Towards Designing Future-Proof Data Processing Systems	2025	VLDB	4.9793485e-05
11,464	Program your (custom) SIMD instruction set on FPGA in C++	2024	CIDR	4.9793485e-05

Outgoing Citations (Sorted by Pagerank)

Showing 16 of 16 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
14	MonetDB/X100: Hyper-Pipelining Query Execution	2005	CIDR	0.00064031282
61	Integrating Compression and Execution in Column-Oriented Database Systems	2006	SIGMOD	0.000392237
219	SIMD-Scan: Ultra Fast in-Memory Table Scan using on-Chip Vector Processing Units	2009	VLDB	0.00024363532
287	Implementing Database Operations Using SIMD Instructions	2002	SIGMOD	0.00021970198
605	Everything You Always Wanted to Know About Compiled and Vectorized Queries But Were Afraid to Ask	2018	VLDB	0.00015647561
627	Rethinking SIMD Vectorization for In-Memory Databases	2015	SIGMOD	0.00015460957
873	BitWeaving: Fast Scans for Main Memory Data Processing	2013	SIGMOD	0.00013338838
906	Data Blocks: Hybrid OLTP and OLAP on Compressed Storage using both Vectorization and Compilation	2016	SIGMOD	0.00013160654
1,423	Procella: Unifying serving and analytical data at YouTube	2019	VLDB	0.00010719956
1,424	Velox: Meta's Unified Execution Engine	2022	VLDB	0.00010719232
1,723	ByteSlice: Pushing the Envelop of Main Memory Data Processing with a New Storage Layout	2015	SIGMOD	9.7931223e-05
1,770	How to Wring a Table Dry: Entropy Compression of Relations and Querying of Compressed Relations	2006	VLDB	9.686541e-05
1,825	Data Management for Data Science: Towards Embedded Analytics	2020	CIDR	9.5603293e-05
3,655	Tile-based Lightweight Integer Compression in GPU	2022	SIGMOD	7.1260841e-05
6,984	Leveraging Compression in the Tableau Data Engine	2014	SIGMOD	5.6285605e-05
7,729	Hardware-Oblivious SIMD Parallelism for In-Memory Column-Stores	2020	CIDR	5.4657611e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	605	Everything You Always Wanted to Know About Compiled and Vectorized Queries But Were Afraid to Ask	2018	VLDB
2	10,901	Overlay Bitmap Encoding for Efficient Consumption of Apache Parquet Files	2026	VLDB
3	10,022	Towards Functional Decomposition of Storage Formats	2025	CIDR
4	219	SIMD-Scan: Ultra Fast in-Memory Table Scan using on-Chip Vector Processing Units	2009	VLDB
5	11,819	Runtime Encoding Execution in AnalyticDB: Efficient Query Executor for Cloud Database	2022	CIDR
6	1,984	How to Barter Bits for Chronons: Compression and Bandwidth Trade Offs for Database Scans	2007	SIGMOD
7	3,655	Tile-based Lightweight Integer Compression in GPU	2022	SIGMOD
8	6,392	Selection Pushdown in Column Stores using Bit Manipulation Instructions	2023	SIGMOD
9	9,863	GPU Acceleration of SQL Analytics on Compressed Data	2026	VLDB
10	8,569	The FastLanes File Format	2025	VLDB