White-box Compression: Learning and Exploiting Compact Table Representations

Summary: White-box compression encodes logical columns as functions over stored physical columns with per-block headers, enabling DBMS-aware optimizations and execution (e.g., predicate push-down). A recursive pattern-driven learner discovers these functions, yielding large compression gains on the Public BI benchmark. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 377
Venue: CIDR
Year: 2020
Pagerank: 6.7804933e-05
Overall Rank: 3,757 | 73.89%
DOI: -

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 11 of 11 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,356	Lakehouse: A New Generation of Open Platforms that Unify Data Warehousing and Advanced Analytics	2021	CIDR	0.00012409986
3,642	BtrBlocks: Efficient Columnar Compression for Data Lakes	2023	SIGMOD	6.8876984e-05
5,105	Analyzing and Comparing Lakehouse Storage Systems	2023	CIDR	5.6916018e-05
8,054	Generating Succinct Descriptions of Database Schemata for Cost-Efficient Prompting of Large Language Models	2024	VLDB	4.5909042e-05
8,090	PIDS: Attribute Decomposition for Improved Compression and Query Performance in Columnar Storage	2020	VLDB	4.5853298e-05
9,595	High-Ratio Compression for Machine-Generated Data	2023	SIGMOD	4.3153078e-05
9,646	The FastLanes File Format	2025	VLDB	4.3067693e-05
9,900	AnyBlox: A Framework for Self-Decoding Datasets	2025	VLDB	4.2539423e-05
10,303	Morphing-based Compression for Data-centric ML Pipelines	2026	VLDB	4.1905499e-05
10,378	An Adaptive Benchmark for Modeling User Exploration of Large Datasets	2025	SIGMOD	4.1905499e-05
11,368	Statistical Schema Learning using Occam's Razor	2022	SIGMOD	4.1905499e-05

Outgoing Citations (Sorted by Pagerank)

Showing 9 of 9 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
132	Integrating Compression and Execution in Column-Oriented Database Systems	2006	SIGMOD	0.00043697853
241	DB2 with BLU Acceleration: So Much More than Just a Column Store	2013	VLDB	0.00031314629
659	The Making of TPC-DS	2006	VLDB	0.00018514913
796	SageDB: A Learned Database System	2019	CIDR	0.00016541749
1,260	Data Blocks: Hybrid OLTP and OLAP on Compressed Storage using both Vectorization and Compilation	2016	SIGMOD	0.00012990853
2,137	How to Wring a Table Dry: Entropy Compression of Relations and Querying of Compressed Relations	2006	VLDB	9.463768e-05
2,153	The Data Calculator*: Data Structure Design and Cost Synthesis from First Principles and Learned Cost Models	2018	SIGMOD	9.418541e-05
5,114	Columnstore and B+ tree – Are Hybrid Physical Designs Important?	2018	SIGMOD	5.6813929e-05
5,677	Joins on Encoded and Partitioned Data	2014	VLDB	5.376511e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
3,741	DeepSqueeze: Deep Semantic Compression for Tabular Data	2020	SIGMOD	6.7952067e-05
9,414	Experimental Analysis of Large-scale Learnable Vector Storage Compression	2024	VLDB	4.3399748e-05
8,360	Query Log Compression for Workload Analytics	2019	VLDB	4.5314883e-05
8,444	Adaptive Compression for Fast Scans on String Columns	2021	SIGMOD	4.5043421e-05
9,595	High-Ratio Compression for Machine-Generated Data	2023	SIGMOD	4.3153078e-05
6,160	Compression Aware Physical Database Design	2011	VLDB	5.1750659e-05
7,431	CompressDB: Enabling Efficient Compressed Data Direct Processing for Various Databases	2022	SIGMOD	4.7274757e-05
4,469	Comprehensive and Efficient Workload Compression	2021	VLDB	6.1535623e-05
7,171	Leveraging Compression in the Tableau Data Engine	2014	SIGMOD	4.8071091e-05
1,098	Query Optimization In Compressed Database Systems	2001	SIGMOD	0.00014070252