Towards Functional Decomposition of Storage Formats

Summary: Shows that tying compression blocks to row‑skipping partitions in columnar formats forces a compressibility vs scan-performance tradeoff; proposes splitting into a storage layer + Search Acceleration Layer (SAL). Finds SALs benefit from fine-grained partitions (~10–100 rows), with optimal size varying by metadata, data, and query, enabling independent tuning and improved tradeoffs. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 545
Venue: CIDR
Year: 2025
Pagerank: 4.2967256e-05
Overall Rank: 9,700 | 32.59%
DOI: -

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 2 of 2 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
9,203	F3: The Open-Source Data File Format for the Future	2026	SIGMOD	4.3701616e-05
9,900	AnyBlox: A Framework for Self-Decoding Datasets	2025	VLDB	4.2539423e-05

Outgoing Citations (Sorted by Pagerank)

Showing 13 of 13 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
80	Weaving Relations for Cache Performance	2001	VLDB	0.00055735291
167	The Snowflake Elastic Data Warehouse	2016	SIGMOD	0.00039408116
367	Small Materialized Aggregates: A Light Weight Index Structure for Data Warehousing	1998	VLDB	0.00025518228
424	Amazon Redshift and the Case for Simpler Data Warehouses	2015	SIGMOD	0.00023604384
739	Delta Lake: High-Performance ACID Table Storage over Cloud Object Stores	2020	VLDB	0.00017365933
936	Data Lake Management: Challenges and Opportunities	2019	VLDB	0.00015197838
1,356	Lakehouse: A New Generation of Open Platforms that Unify Data Warehousing and Advanced Analytics	2021	CIDR	0.00012409986
3,044	Azure Data Lake Store: A Hyperscale Distributed File Service for Big Data Analytics	2017	SIGMOD	7.6624689e-05
3,642	BtrBlocks: Efficient Columnar Compression for Data Lakes	2023	SIGMOD	6.8876984e-05
4,516	An Empirical Evaluation of Columnar Storage Formats	2024	VLDB	6.1146215e-05
5,571	A Deep Dive into Common Open Formats for Analytical DBMSs	2023	VLDB	5.4279553e-05
7,470	Bullion: A Column Store for Machine Learning	2025	CIDR	4.7159125e-05
7,662	Optimizing Collections of Bloom Filters within a Space Budget	2024	VLDB	4.6812878e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
4,107	Cracking the Database Store	2005	CIDR	6.4384924e-05
10,220	FlatStor: An Efficient Embedded-Index Based Columnar Data Layout for Multimodal Data Workloads	2026	VLDB	4.1905499e-05
7,907	Petabyte-Scale Row-Level Operations in Data Lakehouses	2024	VLDB	4.6161532e-05
5,612	Design and Evaluation of Storage Organizations for Read-Optimized Main Memory Databases	2013	VLDB	5.4104818e-05
11,070	Partition, Don’t Sort! Compression Boosters for Cloud Data Ingestion Pipelines	2024	VLDB	4.1905499e-05
6,807	Adaptive Data Skipping in Main-Memory Systems	2016	SIGMOD	4.915939e-05
6,237	Self-Organizing Data Containers	2022	CIDR	5.1371094e-05
12,001	A Partitioning Framework for Aggressive Data Skipping	2014	VLDB	4.1905499e-05
4,516	An Empirical Evaluation of Columnar Storage Formats	2024	VLDB	6.1146215e-05
3,731	Skipping-oriented Partitioning for Columnar Layouts	2017	VLDB	6.8074069e-05