LeCo: Lightweight Compression via Learning Serial Correlations

Summary: LeCo uses learned models to remove serial redundancy in columnar data, unifying FOR, Delta, and RLE as a single framework. Real and synthetic data show Pareto gains in compression and random access; Arrow yields up to 5.2x speedups, RocksDB 16% throughput gain. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 6874
Venue: SIGMOD
Year: 2024
Pagerank: 7.1196234e-05
Overall Rank: 3,416 | 76.24%
DOI: 10.1145/3639320

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 10 of 10 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
4,514	An Empirical Evaluation of Columnar Storage Formats	2024	VLDB	6.1204636e-05
7,390	Making In-Memory Learned Indexes Efficient on Disk	2024	SIGMOD	4.7431654e-05
9,201	F3: The Open-Source Data File Format for the Future	2026	SIGMOD	4.3743539e-05
9,645	The FastLanes File Format	2025	VLDB	4.3109001e-05
10,175	Improving LZ4 for Effective Compression and Efficient Query	2026	SIGMOD	4.1945683e-05
10,304	Eureka: Enabling Fine-Grained Access and Range Queries on Compressed Scientific Data via Data-Index Co-Compression	2026	VLDB	4.1945683e-05
10,326	Learned Static Function Data Structures	2026	VLDB	4.1945683e-05
10,484	Femur: A Flexible Framework for Fast and Secure Querying from Public Key-Value Store	2025	SIGMOD	4.1945683e-05
10,756	Selective Late Materialization in Modern Analytical Databases	2025	VLDB	4.1945683e-05
11,036	Blitzcrank: Fast Semantic Compression for In-memory Online Transaction Processing	2024	VLDB	4.1945683e-05

Outgoing Citations (Sorted by Pagerank)

Showing 37 of 37 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
35	MonetDB/X100: Hyper-Pipelining Query Execution	2005	CIDR	0.00076197749
102	The Case for Learned Index Structures	2018	SIGMOD	0.00049545203
131	Integrating Compression and Execution in Column-Oriented Database Systems	2006	SIGMOD	0.0004370331
167	The Snowflake Elastic Data Warehouse	2016	SIGMOD	0.00039180521
241	DB2 with BLU Acceleration: So Much More than Just a Column Store	2013	VLDB	0.00031420034
310	The Vertica Analytic Database: C-Store 7 Years Later	2012	VLDB	0.00028132402
426	Amazon Redshift and the Case for Simpler Data Warehouses	2015	SIGMOD	0.00023594359
488	TiDB: A Raft-based HTAP Database	2020	VLDB	0.000220409
826	ALEX: An Updatable Adaptive Learned Index	2020	SIGMOD	0.00016224841
857	The PGM-index: a fully-dynamic compressed learned index with provable worst-case bounds	2020	VLDB	0.00015882892
1,053	A Common Database Approach for OLTP and OLAP Using an In-Memory Column Database	2009	SIGMOD	0.00014429683
1,134	Dictionary-based Order-preserving String Compression for Main Memory Column Stores	2009	SIGMOD	0.00013761456
1,169	SuRF: Practical Range Query Filtering with Fast Succinct Tries	2018	SIGMOD	0.00013536447
1,263	Data Blocks: Hybrid OLTP and OLAP on Compressed Storage using both Vectorization and Compilation	2016	SIGMOD	0.00012982857
1,270	BitWeaving: Fast Scans for Main Memory Data Processing	2013	SIGMOD	0.00012926086
1,284	Amazon Redshift Re-invented	2022	SIGMOD	0.00012837822
1,375	FITing-Tree: A Data-aware Index Structure	2019	SIGMOD	0.00012303141
1,598	Semantic Compression and Pattern Extraction with Fascicles	1999	VLDB	0.00011202905
1,792	Hybrid Transactional/Analytical Processing: A Survey	2017	SIGMOD	0.00010537893
2,134	How to Wring a Table Dry: Entropy Compression of Relations and Querying of Compressed Relations	2006	VLDB	9.4741038e-05
2,140	Online Piece-wise Linear Approximation of Numerical Streams with Precision Guarantees*	2009	VLDB	9.4626098e-05
2,312	Real-Time Analytical Processing with SQL Server	2015	VLDB	9.0530853e-05
2,390	ByteSlice: Pushing the Envelop of Main Memory Data Processing with a New Storage Layout	2015	SIGMOD	8.9084657e-05
3,131	FINEdex: A Fine-grained Learned Index Scheme for Scalable and Concurrent Memory Systems	2022	VLDB	7.4985793e-05
3,471	Parallel Replication across Formats in SAP HANA for Scaling Out Mixed OLTP/OLAP Workloads	2017	VLDB	7.0639872e-05
3,745	DeepSqueeze: Deep Semantic Compression for Tabular Data	2020	SIGMOD	6.7926132e-05
4,128	Are Updatable Learned Indexes Ready?	2022	VLDB	6.4292373e-05
4,514	An Empirical Evaluation of Columnar Storage Formats	2024	VLDB	6.1204636e-05
4,628	Sim-Piece: Highly Accurate Piecewise Linear Approximation through Similar Segment Merging	2023	VLDB	6.0379315e-05
4,646	CARMI: A Cache-Aware Learned Index with a Cost-based Construction Algorithm	2022	VLDB	6.0250374e-05
5,186	Query Optimization in Oracle 12c Database In-Memory	2015	VLDB	5.6400929e-05
5,532	A Padded Encoding Scheme to Accelerate Scans by Leveraging Skew	2015	SIGMOD	5.4548897e-05
5,670	Joins on Encoded and Partitioned Data	2014	VLDB	5.3804618e-05
5,835	Order-Preserving Key Compression for In-Memory Search Trees	2020	SIGMOD	5.30905e-05
6,367	Good to the Last Bit: Data-Driven Encoding with CodecDB	2021	SIGMOD	5.0941072e-05
7,335	MorphStore: Analytical Query Engine with a Holistic Compression-Enabled Processing Model	2020	VLDB	4.7603723e-05
8,088	PIDS: Attribute Decomposition for Improved Compression and Query Performance in Columnar Storage	2020	VLDB	4.5897316e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
3,787	White-box Compression: Learning and Exploiting Compact Table Representations	2020	CIDR	6.7674374e-05
10,741	Beyond Compression: A Comprehensive Evaluation of Lossless Floating-Point Compression	2025	VLDB	4.1945683e-05
8,364	Query Log Compression for Workload Analytics	2019	VLDB	4.5357797e-05
9,408	Experimental Analysis of Large-scale Learnable Vector Storage Compression	2024	VLDB	4.3441378e-05
7,429	CompressDB: Enabling Efficient Compressed Data Direct Processing for Various Databases	2022	SIGMOD	4.7320139e-05
8,487	Adaptive Compression for Fast Scans on String Columns	2021	SIGMOD	4.4999394e-05
2,134	How to Wring a Table Dry: Entropy Compression of Relations and Querying of Compressed Relations	2006	VLDB	9.4741038e-05
10,281	GPU Acceleration of SQL Analytics on Compressed Data	2026	VLDB	4.1945683e-05
6,367	Good to the Last Bit: Data-Driven Encoding with CodecDB	2021	SIGMOD	5.0941072e-05
5,898	Column Partition and Permutation for Run Length Encoding in Columnar Databases	2020	SIGMOD	5.2839046e-05