Searching Data Lakes for Nested and Joined Data

Summary: Extends Juneau to search data lakes for hierarchical tables/JSON by matching ranked multi-table join-and-transform views. Novel index/sketch-based result merging scales nested-data discovery, outperforming heuristics in relevance, coverage, speed, and downstream ML utility. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: hee3cd4ed7b3b1f0d
Venue: VLDB
Year: 2024
Pagerank: 4.9793485e-05
Overall Rank: 11,598 | 22.03%
DOI: 10.14778/3681954.3682005

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

1. Yi Zhang (Amazon)
2. Peter Baile Chen (Massachusetts Institute of Technology)
3. Zachary G. Ives (University of Pennsylvania)

BibTeX Citation

@article{zhang_vldb24,
        title = {{Searching Data Lakes for Nested and Joined Data}},
        author = {Zhang, Yi and Chen, Peter Baile and Ives, Zachary G.},
        journal = {PVLDB},
        series = {{VLDB} '24},
        volume = {17},
        number = {11},
        pages = {3346--3359},
        doi = {10.14778/3681954.3682005},
        url = {https://doi.org/10.14778/3681954.3682005},
        year = {2024}
}

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank

Outgoing Citations (Sorted by Pagerank)

Showing 23 of 23 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
5	Optimal Aggregation Algorithms for Middleware [Extended Abstract]	2001	PODS	0.0010679641
29	Fast Algorithms for Mining Association Rules	1994	VLDB	0.0005121339
89	WebTables: Exploring the Power of Tables on the Web	2008	VLDB	0.00035129658
141	Relational Databases for Querying XML Documents: Limitations and Opportunities	1999	VLDB	0.00029294114
326	Storing Semistructured Data with STORED	1999	SIGMOD	0.00020963333
377	TURL: Table Understanding through Representation Learning	2021	VLDB	0.00019570264
507	Supporting Incremental Join Queries on Ranked Inputs	2001	VLDB	0.00017101297
509	Goods: Organizing Google's Datasets	2016	SIGMOD	0.00017071087
624	Data Lake Management: Challenges and Opportunities	2019	VLDB	0.00015479826
694	JOSIE: Overlap Set Similarity Search for Finding Joinable Tables in Data Lakes	2019	SIGMOD	0.00014727089
757	Recovering Semantics of Tables on the Web	2011	VLDB	0.00014205602
972	The Data Civilizer System	2017	CIDR	0.00012763234
1,053	Answering Table Queries on the Web using Column Keywords	2012	VLDB	0.00012274222
1,293	Finding Related Tables in Data Lakes for Interactive Data Science	2020	SIGMOD	0.00011149857
1,318	LSH Ensemble: Internet-Scale Domain Search	2016	VLDB	0.00011047393
1,852	Semantics-aware Dataset Discovery from Data Lakes with Contextualized Column-based Representation Learning	2023	VLDB	9.5004635e-05
1,988	SANTOS: Relationship-based Semantic Table Union Search	2023	SIGMOD	9.2482448e-05
2,382	DeepJoin: Joinable Table Discovery with Pre-trained Language Models	2023	VLDB	8.5458532e-05
2,641	Auto-Suggest: Learning-to-Recommend Data Preparation Steps Using Data Science Notebooks	2020	SIGMOD	8.1787073e-05
3,288	Ten Years of WebTables	2018	VLDB	7.4530805e-05
4,159	Integrating Data Lake Tables	2023	VLDB	6.7717519e-05
5,540	Pre-trained Embeddings for Entity Resolution: An Experimental Analysis	2023	VLDB	6.0907591e-05
7,738	Auto-Validate: Unsupervised Data Validation Using Data-Domain Patterns Inferred from Data Lakes	2021	SIGMOD	5.4623434e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	10,894	MosaicJoin: Compact Semantic Sketches for Value-Level Join Discovery	2026	VLDB
2	694	JOSIE: Overlap Set Similarity Search for Finding Joinable Tables in Data Lakes	2019	SIGMOD
3	765	Table Union Search on Open Data	2018	VLDB
4	2,926	Organizing Data Lakes for Navigation	2020	SIGMOD
5	1,852	Semantics-aware Dataset Discovery from Data Lakes with Contextualized Column-based Representation Learning	2023	VLDB
6	3,090	Correlation Sketches for Approximate Join-Correlation Queries	2021	SIGMOD
7	5,015	Discovering Related Data At Scale	2021	VLDB
8	4,409	LakeBench: A Benchmark for Discovering Joinable and Unionable Tables in Data Lakes	2024	VLDB
9	2,382	DeepJoin: Joinable Table Discovery with Pre-trained Language Models	2023	VLDB
10	1,293	Finding Related Tables in Data Lakes for Interactive Data Science	2020	SIGMOD