DBScholar

Back to papers

Data Lake Management: Challenges and Opportunities

Summary: Data lakes create new management problems—dataset discovery and evolving needs for extraction, cleaning, integration, versioning, and metadata. This tutorial surveys state-of-the-art approaches, challenges, and opportunities unique to data-lake ecosystems for guiding future research. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
12106
Venue
VLDB
Year
2019
Pagerank
0.00014379989
Overall Rank
749 | 94.87%
DOI
10.14778/3352063.3352116

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{nargesian_vldb19,
        title = {{Data Lake Management: Challenges and Opportunities}},
        author = {Nargesian, Fatemeh and Zhu, Erkang and Miller, Renee J. and Pu, Ken Q. and Arocena, Patricia C.},
        journal = {PVLDB},
        series = {{VLDB} '19},
        volume = {12},
        number = {12},
        pages = {1986--1989},
        doi = {10.14778/3352063.3352116},
        url = {https://doi.org/10.14778/3352063.3352116},
        year = {2019}
}

Incoming Citations (Sorted by Pagerank)

Showing 41 of 41 citing papers.

Rank Citing Paper Year Venue Pagerank
713 Language Models Enable Simple Systems for Generating Structured Views of Heterogeneous Data Lakes 2024 VLDB 0.00014672521
1,303 Finding Related Tables in Data Lakes for Interactive Data Science 2020 SIGMOD 0.0001123653
2,192 Semantics-aware Dataset Discovery from Data Lakes with Contextualized Column-based Representation Learning 2023 VLDB 8.9767241e-05
2,242 CHORUS: Foundation Models for Unified Data Discovery and Exploration 2024 VLDB 8.8823802e-05
2,298 GPTuner: A Manual-Reading Database Tuning System via GPT-Guided Bayesian Optimization 2024 VLDB 8.7886538e-05
2,315 SANTOS: Relationship-based Semantic Table Union Search 2023 SIGMOD 8.7605101e-05
4,123 Integrating Data Lake Tables 2023 VLDB 6.8878137e-05
4,382 Slice Tuner: A Selective Data Acquisition Framework for Accurate and Fair Machine Learning Models 2021 SIGMOD 6.7331832e-05
4,785 Data-Sharing Markets: Model, Protocol, and Algorithms to Incentivize the Formation of Data-Sharing Consortia 2023 SIGMOD 6.5084717e-05
4,990 Explaining Dataset Changes for Semantic Data Versioning with Explain-Da-V 2023 VLDB 6.4105738e-05
5,125 Data-Driven Domain Discovery for Structured Datasets 2020 VLDB 6.356638e-05
5,344 Discovering Related Data At Scale 2021 VLDB 6.2591104e-05
5,466 SchemaPile: A Large Collection of Relational Database Schemas 2024 SIGMOD 6.2075052e-05
5,581 Subgraph Matching over Graph Federation 2022 VLDB 6.1624715e-05
5,839 Doing More with Less: Characterizing Dataset Downsampling for AutoML 2021 VLDB 6.0699037e-05
5,956 RONIN: Data Lake Exploration 2021 VLDB 6.0287066e-05
6,315 Data Collection and Quality Challenges for Deep Learning 2020 VLDB 5.915447e-05
7,572 Cross Modal Data Discovery over Structured and Unstructured Data Lakes 2023 VLDB 5.5938952e-05
7,743 Entity Resolution On-Demand 2022 VLDB 5.5545622e-05
7,893 LakeBench: A Benchmark for Discovering Joinable and Unionable Tables in Data Lakes 2024 VLDB 5.5209866e-05
8,605 Unity Catalog: Open and Universal Governance for the Lakehouse and Beyond 2025 SIGMOD 5.4028924e-05
8,903 DataLoom: Simplifying Data Loading with LLMs 2024 VLDB 5.3486551e-05
8,950 OneProvenance: Efficient Extraction of Dynamic Coarse-Grained Provenance From Database Query Event Logs 2023 VLDB 5.345946e-05
9,836 Towards Functional Decomposition of Storage Formats 2025 CIDR 5.2110542e-05
9,929 EquiTensors: Learning Fair Integrations of Heterogeneous Urban Data 2021 SIGMOD 5.1955087e-05
10,109 QueryArtisan: Generating Data Manipulation Codes for Ad-hoc Analysis in Data Lakes 2025 VLDB 5.1347137e-05
10,287 Shape-Agnostic Table Overlap Discovery: A Maximum Common Subhypergraph Approach 2026 SIGMOD 5.093636e-05
10,431 AutoDDG: Automated Dataset Description Generation using Large Language Models 2026 SIGMOD 5.093636e-05
10,486 Qualitative Join Discovery in Data Lakes using Examples 2026 SIGMOD 5.093636e-05
10,783 Table Overlap Estimation through Graph Embeddings 2025 SIGMOD 5.093636e-05
10,897 OpenForge: Probabilistic Metadata Integration 2025 VLDB 5.093636e-05
11,025 A Demonstration of QueryArtisan: Real-Time Data Lake Analysis via Dynamically Generated Data Manipulation Code 2025 VLDB 5.093636e-05
11,030 GraphAr: An Efficient Storage Scheme for Graph Data in Data Lakes 2025 VLDB 5.093636e-05
11,055 Sort it Like You Mean It: Discovering Semantically Interesting Attribute Augmentations to Sort Tables 2025 VLDB 5.093636e-05
11,078 LiquidCache: Efficient Pushdown Caching for Cloud-Native Data Analytics 2025 VLDB 5.093636e-05
11,118 Towards an Objective Metric for Data Value Through Relevance 2024 CIDR 5.093636e-05
11,167 Determining the Largest Overlap between Tables 2024 SIGMOD 5.093636e-05
11,217 FusionQuery: On-demand Fusion Queries over Multi-source Heterogeneous Data 2024 VLDB 5.093636e-05
11,270 Searching Data Lakes for Nested and Joined Data 2024 VLDB 5.093636e-05
11,282 KGFabric: A Scalable Knowledge Graph Warehouse for Enterprise Data Interconnection 2024 VLDB 5.093636e-05
11,618 Detecting Layout Templates in Complex Multiregion Files 2022 VLDB 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 26 of 26 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
91 WebTables: Exploring the Power of Tables on the Web 2008 VLDB 0.00034838835
367 InfoGather: Entity Augmentation and Attribute Discovery By Holistic Matching with Web Tables 2012 SIGMOD 0.00019979463
427 Big Data Integration 2013 VLDB 0.00018661543
493 Data Integration for the Relational Web 2009 VLDB 0.00017558709
514 Goods: Organizing Google's Datasets 2016 SIGMOD 0.00017178673
714 Guided Data Repair 2011 VLDB 0.00014662041
739 Finding Related Tables 2012 SIGMOD 0.0001448231
779 JOSIE: Overlap Set Similarity Search for Finding Joinable Tables in Data Lakes 2019 SIGMOD 0.00014092047
878 Table Union Search on Open Data 2018 VLDB 0.00013463374
963 The Data Civilizer System 2017 CIDR 0.00012935145
1,055 Answering Table Queries on the Web using Column Keywords 2012 VLDB 0.00012389274
1,077 DataHub: Collaborative Data Science & Dataset Version Management at Scale 2015 CIDR 0.00012269438
1,262 Discovering Queries based on Example Tuples 2014 SIGMOD 0.00011427456
1,349 Principles of Dataset Versioning: Exploring the Recreation/Storage Tradeoff 2015 VLDB 0.00011069122
1,495 LSH Ensemble: Internet-Scale Domain Search 2016 VLDB 0.00010571481
1,649 Bootstrapping Pay-As-You-Go Data Integration Systems 2008 SIGMOD 0.00010117306
1,751 Sample-Driven Schema Mapping 2012 SIGMOD 9.838446e-05
1,902 Ground: A Data Context Service 2017 CIDR 9.506714e-05
2,216 Open Data Integration 2018 VLDB 8.9374127e-05
2,415 Schema Extraction for Tabular Data on the Web 2013 VLDB 8.6069635e-05
2,913 Constance: An Intelligent Data Lake System 2016 SIGMOD 7.9684737e-05
3,894 Navigating the Data Lake with DATAMARAN: Automatically Extracting Structure from Log Datasets 2018 SIGMOD 7.0417782e-05
4,201 CLAMS: Bringing Quality to Data Lakes 2016 SIGMOD 6.8355878e-05
4,410 Extracting Databases from Dark Data with DeepDive 2016 SIGMOD 6.717496e-05
6,260 Interactive Navigation of Open Data Linkages 2017 VLDB 5.9371372e-05
6,794 Error Diagnosis and Data Profiling with Data X-Ray 2015 VLDB 5.7712588e-05
Previous Page 1 / 1 Next

Semantically Similar Papers