The FastLanes File Format

Summary: FastLanes is an open-source, SIMD/GPU-oriented columnar format replacing generic compression with cascaded lightweight encodings and multi-column compression. Fine-grained partial decompression enables cache-sized batches, improving both compression ratio and decompression speed over Parquet. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: ha30b6ea9ffedb029
Venue: VLDB
Year: 2025
Pagerank: 5.3132501e-05
Overall Rank: 8,569 | 42.39%
DOI: 10.14778/3749646.3749718

Incoming Non-self Citations Over Time

Authors

1. Azim Afroozeh (Centrum Wiskunde & Informatica)
2. Peter Boncz (Centrum Wiskunde & Informatica)

BibTeX Citation

@article{afroozeh_vldb25,
        title = {{The FastLanes File Format}},
        author = {Afroozeh, Azim and Boncz, Peter},
        journal = {PVLDB},
        series = {{VLDB} '25},
        volume = {18},
        number = {11},
        pages = {4629--4643},
        doi = {10.14778/3749646.3749718},
        url = {https://doi.org/10.14778/3749646.3749718},
        year = {2025}
}

Incoming Citations (Sorted by Pagerank)

Showing 3 of 3 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
10,226	Active Data Lakes: Regaining Physical Data Independence Without Losing Interoperability	2026	VLDB	5.0571508e-05
10,473	L3: A GPU-Native Co-Designed Data Format for Learned Lossless Lightweight Compression	2026	SIGMOD	4.9793485e-05
10,886	Accelerating String-Heavy Queries with LLM Token Tables	2026	VLDB	4.9793485e-05

Outgoing Citations (Sorted by Pagerank)

Showing 39 of 39 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
14	MonetDB/X100: Hyper-Pipelining Query Execution	2005	CIDR	0.00064031282
48	Weaving Relations for Cache Performance	2001	VLDB	0.00043805923
52	The Snowflake Elastic Data Warehouse	2016	SIGMOD	0.00041219077
61	Integrating Compression and Execution in Column-Oriented Database Systems	2006	SIGMOD	0.000392237
71	DuckDB: an Embeddable Analytical Database	2019	SIGMOD	0.00037720227
114	A Decomposition Storage Model	1985	SIGMOD	0.00031928929
148	Gorilla: A Fast, Scalable, In-Memory Time Series Database	2015	VLDB	0.0002900671
216	Small Materialized Aggregates: A Light Weight Index Structure for Data Warehousing	1998	VLDB	0.00024485024
219	SIMD-Scan: Ultra Fast in-Memory Table Scan using on-Chip Vector Processing Units	2009	VLDB	0.00024363532
873	BitWeaving: Fast Scans for Main Memory Data Processing	2013	SIGMOD	0.00013338838
906	Data Blocks: Hybrid OLTP and OLAP on Compressed Storage using both Vectorization and Compilation	2016	SIGMOD	0.00013160654
910	Dictionary-based Order-preserving String Compression for Main Memory Column Stores	2009	SIGMOD	0.00013123912
950	Lakehouse: A New Generation of Open Platforms that Unify Data Warehousing and Advanced Analytics	2021	CIDR	0.00012895553
1,347	Chimp: Efficient Lossless Floating Point Compression for Time Series Databases	2022	VLDB	0.00010950342
1,423	Procella: Unifying serving and analytical data at YouTube	2019	VLDB	0.00010719956
1,424	Velox: Meta's Unified Execution Engine	2022	VLDB	0.00010719232
1,723	ByteSlice: Pushing the Envelop of Main Memory Data Processing with a New Storage Layout	2015	SIGMOD	9.7931223e-05
1,770	How to Wring a Table Dry: Entropy Compression of Relations and Querying of Compressed Relations	2006	VLDB	9.686541e-05
2,185	Database Compression on Graphics Processors	2010	VLDB	8.8948351e-05
2,314	BtrBlocks: Efficient Columnar Compression for Data Lakes	2023	SIGMOD	8.6533171e-05
2,928	ALP: Adaptive Lossless floating-Point Compression	2023	SIGMOD	7.8424335e-05
3,146	White-box Compression: Learning and Exploiting Compact Table Representations	2020	CIDR	7.5963816e-05
3,181	The FastLanes Compression Layout: Decoding >100 Billion Integers per Second with Scalar Code	2023	VLDB	7.5625307e-05
3,580	Elf: Erasing-based Lossless Floating-Point Compression	2023	VLDB	7.1923905e-05
3,655	Tile-based Lightweight Integer Compression in GPU	2022	SIGMOD	7.1260841e-05
3,808	An Empirical Evaluation of Columnar Storage Formats	2024	VLDB	7.0097354e-05
4,153	LeCo: Lightweight Compression via Learning Serial Correlations	2024	SIGMOD	6.776246e-05
4,635	A Deep Dive into Common Open Formats for Analytical DBMSs	2023	VLDB	6.4932705e-05
5,397	Order-Preserving Key Compression for In-Memory Search Trees	2020	SIGMOD	6.1490013e-05
5,471	Good to the Last Bit: Data-Driven Encoding with CodecDB	2021	SIGMOD	6.1181669e-05
6,392	Selection Pushdown in Column Stores using Bit Manipulation Instructions	2023	SIGMOD	5.800848e-05
6,417	MorphStore: Analytical Query Engine with a Holistic Compression-Enabled Processing Model	2020	VLDB	5.791405e-05
6,737	CompressDB: Enabling Efficient Compressed Data Direct Processing for Various Databases	2022	SIGMOD	5.6925989e-05
6,906	MILC: Inverted List Compression in Memory	2017	VLDB	5.6498626e-05
6,984	Leveraging Compression in the Tableau Data Engine	2014	SIGMOD	5.6285605e-05
7,350	Bullion: A Column Store for Machine Learning	2025	CIDR	5.5451228e-05
8,160	PIDS: Attribute Decomposition for Improved Compression and Query Performance in Columnar Storage	2020	VLDB	5.3871591e-05
9,843	High-Ratio Compression for Machine-Generated Data	2023	SIGMOD	5.1223012e-05
10,241	Rethinking the Encoding of Integers for Scans on Skewed Data	2023	SIGMOD	5.0531436e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	6,737	CompressDB: Enabling Efficient Compressed Data Direct Processing for Various Databases	2022	SIGMOD
2	10,022	Towards Functional Decomposition of Storage Formats	2025	CIDR
3	8,552	F3: The Open-Source Data File Format for the Future	2026	SIGMOD
4	10,905	ZipFlow: a Compiler-based Framework to Unleash Compressed Data Movement for Modern GPUs	2026	VLDB
5	6,297	Mainlining Databases: Supporting Fast Transactional Workloads on Universal Columnar Data File Formats	2021	VLDB
6	10,694	FlatStor: An Efficient Embedded-Index Based Columnar Data Layout for Multimodal Data Workloads	2026	VLDB
7	9,863	GPU Acceleration of SQL Analytics on Compressed Data	2026	VLDB
8	2,314	BtrBlocks: Efficient Columnar Compression for Data Lakes	2023	SIGMOD
9	3,808	An Empirical Evaluation of Columnar Storage Formats	2024	VLDB
10	3,181	The FastLanes Compression Layout: Decoding >100 Billion Integers per Second with Scalar Code	2023	VLDB