Searching Data Lakes for Nested and Joined Data

Summary: Extends Juneau to search data lakes for hierarchical tables/JSON by matching ranked multi-table join-and-transform views. Novel index/sketch-based result merging scales nested-data discovery, outperforming heuristics in relevance, coverage, speed, and downstream ML utility. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: hee3cd4ed7b3b1f0d
Venue: VLDB
Year: 2024
Pagerank: 4.9605343e-05
Overall Rank: 11,651 | 21.91%
DOI: 10.14778/3681954.3682005
PDF: Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

1. Yi Zhang (Amazon)
2. Peter Baile Chen (Massachusetts Institute of Technology)
3. Zachary G. Ives (University of Pennsylvania)

BibTeX Citation

@article{zhang_vldb24,
        title = {{Searching Data Lakes for Nested and Joined Data}},
        author = {Zhang, Yi and Chen, Peter Baile and Ives, Zachary G.},
        journal = {PVLDB},
        series = {{VLDB} '24},
        volume = {17},
        number = {11},
        pages = {3346--3359},
        doi = {10.14778/3681954.3682005},
        url = {https://doi.org/10.14778/3681954.3682005},
        year = {2024}
}

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank

Outgoing Citations (Sorted by Pagerank)

Showing 23 of 23 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
5	Optimal Aggregation Algorithms for Middleware [Extended Abstract]	2001	PODS	0.0010688884
29	Fast Algorithms for Mining Association Rules	1994	VLDB	0.00051028332
88	WebTables: Exploring the Power of Tables on the Web	2008	VLDB	0.00035500667
141	Relational Databases for Querying XML Documents: Limitations and Opportunities	1999	VLDB	0.00029191386
329	Storing Semistructured Data with STORED	1999	SIGMOD	0.00020888032
366	TURL: Table Understanding through Representation Learning	2021	VLDB	0.00019902067
511	Supporting Incremental Join Queries on Ranked Inputs	2001	VLDB	0.00017061618
512	Goods: Organizing Google's Datasets	2016	SIGMOD	0.00017036842
623	Data Lake Management: Challenges and Opportunities	2019	VLDB	0.00015446839
679	JOSIE: Overlap Set Similarity Search for Finding Joinable Tables in Data Lakes	2019	SIGMOD	0.00014802
753	Recovering Semantics of Tables on the Web	2011	VLDB	0.00014228161
972	The Data Civilizer System	2017	CIDR	0.00012742827
1,037	Answering Table Queries on the Web using Column Keywords	2012	VLDB	0.00012357454
1,268	Finding Related Tables in Data Lakes for Interactive Data Science	2020	SIGMOD	0.00011243615
1,325	LSH Ensemble: Internet-Scale Domain Search	2016	VLDB	0.000110184
1,742	Semantics-aware Dataset Discovery from Data Lakes with Contextualized Column-based Representation Learning	2023	VLDB	9.7283207e-05
1,929	SANTOS: Relationship-based Semantic Table Union Search	2023	SIGMOD	9.3458857e-05
2,370	DeepJoin: Joinable Table Discovery with Pre-trained Language Models	2023	VLDB	8.5469172e-05
2,645	Auto-Suggest: Learning-to-Recommend Data Preparation Steps Using Data Science Notebooks	2020	SIGMOD	8.1641056e-05
3,247	Ten Years of WebTables	2018	VLDB	7.4774952e-05
4,158	Integrating Data Lake Tables	2023	VLDB	6.7595989e-05
5,539	Pre-trained Embeddings for Entity Resolution: An Experimental Analysis	2023	VLDB	6.0745352e-05
7,755	Auto-Validate: Unsupervised Data Validation Using Data-Domain Patterns Inferred from Data Lakes	2021	SIGMOD	5.4424293e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	10,964	MosaicJoin: Compact Semantic Sketches for Value-Level Join Discovery	2026	VLDB
2	679	JOSIE: Overlap Set Similarity Search for Finding Joinable Tables in Data Lakes	2019	SIGMOD
3	758	Table Union Search on Open Data	2018	VLDB
4	2,940	Organizing Data Lakes for Navigation	2020	SIGMOD
5	1,742	Semantics-aware Dataset Discovery from Data Lakes with Contextualized Column-based Representation Learning	2023	VLDB
6	3,093	Correlation Sketches for Approximate Join-Correlation Queries	2021	SIGMOD
7	5,036	Discovering Related Data At Scale	2021	VLDB
8	4,419	LakeBench: A Benchmark for Discovering Joinable and Unionable Tables in Data Lakes	2024	VLDB
9	2,370	DeepJoin: Joinable Table Discovery with Pre-trained Language Models	2023	VLDB
10	1,268	Finding Related Tables in Data Lakes for Interactive Data Science	2020	SIGMOD