Data Profiling – A Tutorial

Summary: Tutorial on data profiling: metadata discovery, profiling tasks, and a survey of relational profiling systems. Addresses hard problems: dependency discovery, dynamic/streaming data, and visualization/interpretation; outlines future research directions. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: hd9c45f1c6b8054e1
Venue: SIGMOD
Year: 2017
Pagerank: 7.3210362e-05
Overall Rank: 3,418 | 77.03%
DOI: 10.1145/3035918.3054772

Incoming Non-self Citations Over Time

Authors

1. Ziawasch Abedjan (Technical University of Berlin)
2. Lukasz Golab (University of Waterloo)
3. Felix Naumann (Hasso Plattner Institute)

BibTeX Citation

@inproceedings{abedjan_sigmod17,
        title = {{Data Profiling – A Tutorial}},
        author = {Abedjan, Ziawasch and Golab, Lukasz and Naumann, Felix},
        series = {{SIGMOD} '17},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3035918.3054772},
        url = {https://dl.acm.org/doi/10.1145/3035918.3054772},
        year = {2017}
}

Incoming Citations (Sorted by Pagerank)

Showing 12 of 12 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
5,280	Fast Approximate Denial Constraint Discovery	2023	VLDB	6.1992888e-05
6,855	Fast Incremental Discovery of Pointwise Order Dependencies	2020	VLDB	5.6642528e-05
6,921	CtxPipe: Context-aware Data Preparation Pipeline Construction for Machine Learning	2024	SIGMOD	5.6432616e-05
7,952	The Power of Constraints in Natural Language to SQL Translation	2025	VLDB	5.4198293e-05
8,507	DataProf: Semantic Profiling for Iterative Data Cleansing and Business Rule Acquisition	2018	SIGMOD	5.3269911e-05
8,852	Rapidash: Efficient Detection of Constraint Violations	2024	VLDB	5.2641151e-05
9,549	GIO: Generating Efficient Matrix and Frame Readers for Custom Data Formats by Example	2023	SIGMOD	5.1599622e-05
10,058	Discovering Approximate Inclusion Dependencies	2025	VLDB	5.0875952e-05
10,106	Efficient Differential Dependency Discovery	2024	VLDB	5.0789354e-05
11,254	Efficient Discovery of Relaxed Functional Dependencies	2025	VLDB	4.9793485e-05
11,284	CatDB: Data-catalog-guided, LLM-based Generation of Data-centric ML Pipelines	2025	VLDB	4.9793485e-05
11,967	INCA: Inconsistency-Aware Data Profiling and Querying	2021	SIGMOD	4.9793485e-05

Outgoing Citations (Sorted by Pagerank)

Showing 19 of 19 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
95	Potter's Wheel: An Interactive Data Cleaning System	2001	VLDB	0.00034382643
105	The MADlib Analytics Library or MAD Skills, the SQL	2012	VLDB	0.00033638251
160	CORDS: Automatic Discovery of Correlations and Soft Functional Dependencies	2004	SIGMOD	0.00027837289
350	Discovering Denial Constraints	2013	VLDB	0.00020253521
435	Mining Database Structure; Or, How to Build a Data Quality Browser	2002	SIGMOD	0.0001832766
509	Goods: Organizing Google's Datasets	2016	SIGMOD	0.00017071087
603	A Hybrid Approach to Functional Dependency Discovery	2016	SIGMOD	0.00015699254
972	The Data Civilizer System	2017	CIDR	0.00012763234
1,291	Extending Dependencies with Conditions	2007	VLDB	0.00011156154
1,395	Data Profiling with Metanome	2015	VLDB	0.00010794808
1,887	Sequential Dependencies	2009	VLDB	9.4321643e-05
1,969	Information-Theoretic Tools for Mining Database Structure from Large Data Sets	2004	SIGMOD	9.2935435e-05
4,226	Scalable Discovery of Unique Column Combinations	2014	VLDB	6.7183259e-05
4,246	Divide & Conquer-based Inclusion Dependency Discovery	2015	VLDB	6.7061689e-05
4,465	Effective and Complete Discovery of Order Dependencies via Set-based Axiomatization	2017	VLDB	6.5873563e-05
4,650	Temporal Rules Discovery for Web Data Cleaning	2016	VLDB	6.4858157e-05
4,723	Data Auditor: Exploring Data Quality and Semantics using Pattern Tableaux	2010	VLDB	6.4528647e-05
5,564	Challenges and Opportunities with Big Data	2012	VLDB	6.0827407e-05
6,171	Fundamentals of Order Dependencies	2012	VLDB	5.8623235e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	2,916	Extracting and Analyzing Hidden Graphs from Relational Databases	2017	SIGMOD
2	5,464	Data Stream Query Processing: A Tutorial	2003	VLDB
3	1,390	Metadata Management for Large Statistical Databases	1982	VLDB
4	1,290	Querying and Mining Data Streams: You Only Get One Look	2002	SIGMOD
5	3,470	Automatic Discovery of Attributes in Relational Databases	2011	SIGMOD
6	8,510	Exploring the Data Wilderness through Examples	2019	SIGMOD
7	14,047	Bridging the Application and DBMS Divide Using Static Analysis and Dynamic Profiling	2009	SIGMOD
8	7,062	Towards NLP-Enhanced Data Profiling Tools	2022	CIDR
9	1,215	Overview of Data Exploration Techniques	2015	SIGMOD
10	1,395	Data Profiling with Metanome	2015	VLDB