Towards Functional Decomposition of Storage Formats

Summary: Shows that tying compression blocks to row‑skipping partitions in columnar formats forces a compressibility vs scan-performance tradeoff; proposes splitting into a storage layer + Search Acceleration Layer (SAL). Finds SALs benefit from fine-grained partitions (~10–100 rows), with optimal size varying by metadata, data, and query, enabling independent tuning and improved tradeoffs. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 545
Venue: CIDR
Year: 2025
Pagerank: 4.3008468e-05
Overall Rank: 9,701 | 32.52%
DOI: -

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 2 of 2 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
9,201	F3: The Open-Source Data File Format for the Future	2026	SIGMOD	4.3743539e-05
9,901	AnyBlox: A Framework for Self-Decoding Datasets	2025	VLDB	4.258022e-05

Outgoing Citations (Sorted by Pagerank)

Showing 13 of 13 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
80	Weaving Relations for Cache Performance	2001	VLDB	0.00055721729
167	The Snowflake Elastic Data Warehouse	2016	SIGMOD	0.00039180521
368	Small Materialized Aggregates: A Light Weight Index Structure for Data Warehousing	1998	VLDB	0.000254931
426	Amazon Redshift and the Case for Simpler Data Warehouses	2015	SIGMOD	0.00023594359
746	Delta Lake: High-Performance ACID Table Storage over Cloud Object Stores	2020	VLDB	0.00017326979
939	Data Lake Management: Challenges and Opportunities	2019	VLDB	0.00015187344
1,377	Lakehouse: A New Generation of Open Platforms that Unify Data Warehousing and Advanced Analytics	2021	CIDR	0.00012296941
3,038	Azure Data Lake Store: A Hyperscale Distributed File Service for Big Data Analytics	2017	SIGMOD	7.6717218e-05
3,644	BtrBlocks: Efficient Columnar Compression for Data Lakes	2023	SIGMOD	6.8854928e-05
4,514	An Empirical Evaluation of Columnar Storage Formats	2024	VLDB	6.1204636e-05
5,562	A Deep Dive into Common Open Formats for Analytical DBMSs	2023	VLDB	5.4331334e-05
7,469	Bullion: A Column Store for Machine Learning	2025	CIDR	4.7204398e-05
7,663	Optimizing Collections of Bloom Filters within a Space Budget	2024	VLDB	4.6857816e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
4,108	Cracking the Database Store	2005	CIDR	6.4440088e-05
10,220	FlatStor: An Efficient Embedded-Index Based Columnar Data Layout for Multimodal Data Workloads	2026	VLDB	4.1945683e-05
7,907	Petabyte-Scale Row-Level Operations in Data Lakehouses	2024	VLDB	4.6205839e-05
5,604	Design and Evaluation of Storage Organizations for Read-Optimized Main Memory Databases	2013	VLDB	5.4147933e-05
11,067	Partition, Don’t Sort! Compression Boosters for Cloud Data Ingestion Pipelines	2024	VLDB	4.1945683e-05
6,809	Adaptive Data Skipping in Main-Memory Systems	2016	SIGMOD	4.9206606e-05
6,279	Self-Organizing Data Containers	2022	CIDR	5.1295282e-05
11,993	A Partitioning Framework for Aggressive Data Skipping	2014	VLDB	4.1945683e-05
4,514	An Empirical Evaluation of Columnar Storage Formats	2024	VLDB	6.1204636e-05
3,737	Skipping-oriented Partitioning for Columnar Layouts	2017	VLDB	6.8033227e-05