Data Profiling – A Tutorial

Summary: Tutorial on data profiling: metadata discovery, profiling tasks, and a survey of relational profiling systems. Addresses hard problems: dependency discovery, dynamic/streaming data, and visualization/interpretation; outlines future research directions. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: hd9c45f1c6b8054e1
Venue: SIGMOD
Year: 2017
Pagerank: 7.3175997e-05
Overall Rank: 3,419 | 77.03%
DOI: 10.1145/3035918.3054772

Incoming Non-self Citations Over Time

Authors

1. Ziawasch Abedjan (Technical University of Berlin)
2. Lukasz Golab (University of Waterloo)
3. Felix Naumann (Hasso Plattner Institute)

BibTeX Citation

@inproceedings{abedjan_sigmod17,
        title = {{Data Profiling – A Tutorial}},
        author = {Abedjan, Ziawasch and Golab, Lukasz and Naumann, Felix},
        series = {{SIGMOD} '17},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3035918.3054772},
        url = {https://dl.acm.org/doi/10.1145/3035918.3054772},
        year = {2017}
}

Incoming Citations (Sorted by Pagerank)

Showing 12 of 12 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
5,283	Fast Approximate Denial Constraint Discovery	2023	VLDB	6.1963542e-05
6,860	Fast Incremental Discovery of Pointwise Order Dependencies	2020	VLDB	5.6615714e-05
6,924	CtxPipe: Context-aware Data Preparation Pipeline Construction for Machine Learning	2024	SIGMOD	5.6405901e-05
7,956	The Power of Constraints in Natural Language to SQL Translation	2025	VLDB	5.4172636e-05
8,513	DataProf: Semantic Profiling for Iterative Data Cleansing and Business Rule Acquisition	2018	SIGMOD	5.3244694e-05
8,862	Rapidash: Efficient Detection of Constraint Violations	2024	VLDB	5.2616231e-05
9,545	GIO: Generating Efficient Matrix and Frame Readers for Custom Data Formats by Example	2023	SIGMOD	5.1600923e-05
10,063	Discovering Approximate Inclusion Dependencies	2025	VLDB	5.0851868e-05
10,110	Efficient Differential Dependency Discovery	2024	VLDB	5.0765311e-05
11,262	Efficient Discovery of Relaxed Functional Dependencies	2025	VLDB	4.9769913e-05
11,292	CatDB: Data-catalog-guided, LLM-based Generation of Data-centric ML Pipelines	2025	VLDB	4.9769913e-05
11,973	INCA: Inconsistency-Aware Data Profiling and Querying	2021	SIGMOD	4.9769913e-05

Outgoing Citations (Sorted by Pagerank)

Showing 19 of 19 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
95	Potter's Wheel: An Interactive Data Cleaning System	2001	VLDB	0.00034367518
105	The MADlib Analytics Library or MAD Skills, the SQL	2012	VLDB	0.00033633007
160	CORDS: Automatic Discovery of Correlations and Soft Functional Dependencies	2004	SIGMOD	0.00027827605
350	Discovering Denial Constraints	2013	VLDB	0.00020244085
435	Mining Database Structure; Or, How to Build a Data Quality Browser	2002	SIGMOD	0.0001831946
509	Goods: Organizing Google's Datasets	2016	SIGMOD	0.00017063491
603	A Hybrid Approach to Functional Dependency Discovery	2016	SIGMOD	0.00015692059
972	The Data Civilizer System	2017	CIDR	0.00012757732
1,291	Extending Dependencies with Conditions	2007	VLDB	0.00011150915
1,394	Data Profiling with Metanome	2015	VLDB	0.00010791559
1,888	Sequential Dependencies	2009	VLDB	9.4276992e-05
1,970	Information-Theoretic Tools for Mining Database Structure from Large Data Sets	2004	SIGMOD	9.2892451e-05
4,226	Scalable Discovery of Unique Column Combinations	2014	VLDB	6.7151469e-05
4,247	Divide & Conquer-based Inclusion Dependency Discovery	2015	VLDB	6.703008e-05
4,467	Effective and Complete Discovery of Order Dependencies via Set-based Axiomatization	2017	VLDB	6.5842379e-05
4,652	Temporal Rules Discovery for Web Data Cleaning	2016	VLDB	6.4828106e-05
4,724	Data Auditor: Exploring Data Quality and Semantics using Pattern Tableaux	2010	VLDB	6.4498285e-05
5,566	Challenges and Opportunities with Big Data	2012	VLDB	6.0798625e-05
6,173	Fundamentals of Order Dependencies	2012	VLDB	5.8595496e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	2,918	Extracting and Analyzing Hidden Graphs from Relational Databases	2017	SIGMOD
2	5,468	Data Stream Query Processing: A Tutorial	2003	VLDB
3	1,392	Metadata Management for Large Statistical Databases	1982	VLDB
4	1,290	Querying and Mining Data Streams: You Only Get One Look	2002	SIGMOD
5	3,470	Automatic Discovery of Attributes in Relational Databases	2011	SIGMOD
6	8,516	Exploring the Data Wilderness through Examples	2019	SIGMOD
7	14,052	Bridging the Application and DBMS Divide Using Static Analysis and Dynamic Profiling	2009	SIGMOD
8	7,063	Towards NLP-Enhanced Data Profiling Tools	2022	CIDR
9	1,216	Overview of Data Exploration Techniques	2015	SIGMOD
10	1,394	Data Profiling with Metanome	2015	VLDB