Petabyte-Scale Row-Level Operations in Data Lakehouses

Summary: Adds petabyte-scale row-level updates/deletes to Iceberg+Spark via file-level materialization or lazy equality/position deletes. Avoids shuffles with storage-partitioned joins, cuts write amplification with runtime filters, and uses adaptive writes; shows use-case tradeoffs and ~10× gains. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 13803
Venue: VLDB
Year: 2024
Pagerank: 5.5457298e-05
Overall Rank: 7,780 | 46.63%
DOI: 10.14778/3685800.3685834

Incoming Non-self Citations Over Time

Authors

1. Anton Okolnychyi (Apple)
2. Chao Sun (Apple)
3. Kazuyuki Tanimura (Apple)
4. Russell Spitzer (Apple)
5. Ryan Blue (Tabular)
6. Szehon Ho (Apple)
7. Yufei Gu (Apple)
8. Vishwanath Lakkundi (Apple)
9. DB Tsai (Apple)

BibTeX Citation

@article{okolnychyi_vldb24,
        title = {{Petabyte-Scale Row-Level Operations in Data Lakehouses}},
        author = {Okolnychyi, Anton and Sun, Chao and Tanimura, Kazuyuki and Spitzer, Russell and Blue, Ryan and Ho, Szehon and Gu, Yufei and Lakkundi, Vishwanath and Tsai, DB},
        journal = {PVLDB},
        series = {{VLDB} '24},
        volume = {17},
        number = {12},
        pages = {4159--4172},
        doi = {10.14778/3685800.3685834},
        url = {https://doi.org/10.14778/3685800.3685834},
        year = {2024}
}

Incoming Citations (Sorted by Pagerank)

Showing 3 of 3 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
9,378	AutoComp: Automated Data Compaction for Log-Structured Tables in Data Lakes	2025	SIGMOD	5.2755515e-05
10,976	TreeCat: Standalone Catalog Engine for Large Data Systems	2025	VLDB	5.093636e-05
11,006	Magnus: A Holistic Approach to Data Management for Large-Scale Machine Learning Workloads	2025	VLDB	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 21 of 21 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
12	C-Store: A Column-oriented DBMS	2005	VLDB	0.00069513174
14	MonetDB/X100: Hyper-Pipelining Query Execution	2005	CIDR	0.0006312782
19	A Critique of ANSI SQL Isolation Levels	1995	SIGMOD	0.00058720861
24	Spark SQL: Relational Data Processing in Spark	2015	SIGMOD	0.00054865648
59	Differential Files: Their Application To The Maintenance Of Large Data Bases	1976	SIGMOD	0.00040060625
66	The Snowflake Elastic Data Warehouse	2016	SIGMOD	0.00038561587
227	Small Materialized Aggregates: A Light Weight Index Structure for Data Warehousing	1998	VLDB	0.00023958508
237	Amazon Redshift and the Case for Simpler Data Warehouses	2015	SIGMOD	0.0002369895
245	Serializable Isolation for Snapshot Databases	2008	SIGMOD	0.00023458287
520	Delta Lake: High-Performance ACID Table Storage over Cloud Object Stores	2020	VLDB	0.00017136828
660	Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing)	2010	VLDB	0.00015198804
1,138	Lakehouse: A New Generation of Open Platforms that Unify Data Warehousing and Advanced Analytics	2021	CIDR	0.00012023643
1,453	Dremel: A Decade of Interactive SQL Analysis at Web Scale	2020	VLDB	0.00010742227
1,629	Positional Update Handling in Column Stores	2010	SIGMOD	0.00010184131
2,642	CoHadoop: Flexible Data Placement and Its Exploitation in Hadoop	2011	VLDB	8.3059948e-05
3,555	Apache Hive: From MapReduce to Enterprise-grade Big Data Warehousing	2019	SIGMOD	7.3115321e-05
4,120	Big Metadata: When Metadata is Big Data	2021	VLDB	6.8896959e-05
4,457	Analyzing and Comparing Lakehouse Storage Systems	2023	CIDR	6.6913393e-05
5,390	Magnet: Push-based Shuffle Service for Large-scale Data Processing	2020	VLDB	6.2346971e-05
6,103	VectorH: Taking SQL-on-Hadoop to the Next Level	2016	SIGMOD	5.9755412e-05
8,467	LST-Bench: Benchmarking Log-Structured Tables in the Cloud	2024	SIGMOD	5.4187125e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	11,742	Pixels: Multiversion Wide Table Store for Data Lakes	2020	CIDR
2	4,649	BigLake: BigQuery’s Evolution toward a Multi-Cloud Lakehouse	2024	SIGMOD
3	9,378	AutoComp: Automated Data Compaction for Log-Structured Tables in Data Lakes	2025	SIGMOD
4	9,836	Towards Functional Decomposition of Storage Formats	2025	CIDR
5	520	Delta Lake: High-Performance ACID Table Storage over Cloud Object Stores	2020	VLDB
6	3,555	Apache Hive: From MapReduce to Enterprise-grade Big Data Warehousing	2019	SIGMOD
7	10,536	Active Data Lakes: Regaining Physical Data Independence Without Losing Interoperability	2026	VLDB
8	1,138	Lakehouse: A New Generation of Open Platforms that Unify Data Warehousing and Advanced Analytics	2021	CIDR
9	4,457	Analyzing and Comparing Lakehouse Storage Systems	2023	CIDR
10	5,983	Adaptive and Robust Query Execution for Lakehouses at Scale	2024	VLDB