The Challenge of Building Effective Data Lakes

Summary: Data lakes offer scalable cloud storage for analytics but lack context, quality, and discoverability, eroding trust in analytics. Emphasizes real-world implementation patterns and the need for automated, learning-based discovery at enterprise scale. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 6065
Venue: SIGMOD
Year: 2020
Pagerank: -
Overall Rank: 13,479 | 7.53%
DOI: 10.1145/3318464.3393816

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

1. Awez Syed (Databricks)

BibTeX Citation

@inproceedings{syed_sigmod20,
        title = {{The Challenge of Building Effective Data Lakes}},
        author = {Syed, Awez},
        series = {{SIGMOD} '20},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3318464.3393816},
        url = {https://dl.acm.org/doi/10.1145/3318464.3393816},
        year = {2020}
}

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank

Outgoing Citations (Sorted by Pagerank)

Showing 0 of 0 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	13,702	Is It Still "Big Data" If It Fits In My Pocket?	2011	VLDB
2	10,121	End-to-End Declarative Data Analytics: Co-designing Engines, Interfaces, and Cloud Infrastructure	2026	CIDR
3	13,447	Deep Data Integration	2021	SIGMOD
4	2,913	Constance: An Intelligent Data Lake System	2016	SIGMOD
5	6,355	When the Web is your Data Lake: Creating a Search Engine for Datasets on the Web	2020	SIGMOD
6	11,062	Data Discovery in Data Lakes: Operations, Indexes, Systems	2025	VLDB
7	1,138	Lakehouse: A New Generation of Open Platforms that Unify Data Warehousing and Advanced Analytics	2021	CIDR
8	9,694	Bringing the Operational and Analytical Worlds Together with Lakebase	2025	VLDB
9	1,947	Data Wrangling: The Challenging Journey from the Wild to the Lake	2015	CIDR
10	749	Data Lake Management: Challenges and Opportunities	2019	VLDB