White-box Compression: Learning and Exploiting Compact Table Representations

Summary: White-box compression encodes logical columns as functions over stored physical columns with per-block headers, enabling DBMS-aware optimizations and execution (e.g., predicate push-down). A recursive pattern-driven learner discovers these functions, yielding large compression gains on the Public BI benchmark. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: h4f5cf3ed7e21c6ea
Venue: CIDR
Year: 2020
Pagerank: 7.5927972e-05
Overall Rank: 3,147 | 78.85%
DOI: -
PDF: Download (CC BY 3.0)

Incoming Non-self Citations Over Time

Authors

1. Bogdan Ghiță (Centrum Wiskunde & Informatica)
2. Diego Tomé (Centrum Wiskunde & Informatica)
3. Peter Boncz (Centrum Wiskunde & Informatica)

BibTeX Citation

@inproceedings{ghita_cidr20,
        address = {Amsterdam, Netherlands},
        series = {{CIDR} '20},
        title = {{White-box Compression: Learning and Exploiting Compact Table Representations}},
        booktitle = {Proceedings of the {Conference} on {Innovative} {Data} {Systems} {Research}},
        author = {Ghiță, Bogdan and Tomé, Diego and Boncz, Peter},
        year = {2020}
}

Incoming Citations (Sorted by Pagerank)

Showing 13 of 13 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
950	Lakehouse: A New Generation of Open Platforms that Unify Data Warehousing and Advanced Analytics	2021	CIDR	0.00012889569
2,317	BtrBlocks: Efficient Columnar Compression for Data Lakes	2023	SIGMOD	8.6492924e-05
4,332	Analyzing and Comparing Lakehouse Storage Systems	2023	CIDR	6.6556222e-05
8,021	Generating Succinct Descriptions of Database Schemata for Cost-Efficient Prompting of Large Language Models	2024	VLDB	5.4041713e-05
8,166	PIDS: Attribute Decomposition for Improved Compression and Query Performance in Columnar Storage	2020	VLDB	5.3846089e-05
8,577	The FastLanes File Format	2025	VLDB	5.3107348e-05
9,850	High-Ratio Compression for Machine-Generated Data	2023	SIGMOD	5.1198764e-05
10,130	An Adaptive Benchmark for Modeling User Exploration of Large Datasets	2025	SIGMOD	5.0727027e-05
10,256	AnyBlox: A Framework for Self-Decoding Datasets	2025	VLDB	5.0495724e-05
10,866	Interoperable ACID Transactions for Open Table Formats	2026	VLDB	4.9769913e-05
10,895	Accelerating String-Heavy Queries with LLM Token Tables	2026	VLDB	4.9769913e-05
10,954	Morphing-based Compression for Data-centric ML Pipelines	2026	VLDB	4.9769913e-05
11,879	Statistical Schema Learning using Occam's Razor	2022	SIGMOD	4.9769913e-05

Outgoing Citations (Sorted by Pagerank)

Showing 9 of 9 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
61	Integrating Compression and Execution in Column-Oriented Database Systems	2006	SIGMOD	0.00039236924
163	DB2 with BLU Acceleration: So Much More than Just a Column Store	2013	VLDB	0.00027480091
480	The Making of TPC-DS	2006	VLDB	0.00017615432
555	SageDB: A Learned Database System	2019	CIDR	0.0001650754
907	Data Blocks: Hybrid OLTP and OLAP on Compressed Storage using both Vectorization and Compilation	2016	SIGMOD	0.00013157412
1,606	The Data Calculator*: Data Structure Design and Cost Synthesis from First Principles and Learned Cost Models	2018	SIGMOD	0.00010091937
1,770	How to Wring a Table Dry: Entropy Compression of Relations and Querying of Compressed Relations	2006	VLDB	9.6822825e-05
4,692	Columnstore and B+ tree – Are Hybrid Physical Designs Important?	2018	SIGMOD	6.4656516e-05
5,427	Joins on Encoded and Partitioned Data	2014	VLDB	6.133151e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	9,705	Experimental Analysis of Large-scale Learnable Vector Storage Compression	2024	VLDB
2	8,644	Query Log Compression for Workload Analytics	2019	VLDB
3	8,615	Adaptive Compression for Fast Scans on String Columns	2021	SIGMOD
4	9,850	High-Ratio Compression for Machine-Generated Data	2023	SIGMOD
5	5,856	Compression Aware Physical Database Design	2011	VLDB
6	5,492	Compressed Representations of Conjunctive Query Results	2018	PODS
7	6,736	CompressDB: Enabling Efficient Compressed Data Direct Processing for Various Databases	2022	SIGMOD
8	3,809	Comprehensive and Efficient Workload Compression	2021	VLDB
9	6,987	Leveraging Compression in the Tableau Data Engine	2014	SIGMOD
10	898	Query Optimization In Compressed Database Systems	2001	SIGMOD