Data Profiling – A Tutorial

Summary: Tutorial on data profiling: metadata discovery, profiling tasks, and a survey of relational profiling systems. Addresses hard problems: dependency discovery, dynamic/streaming data, and visualization/interpretation; outlines future research directions. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: hd9c45f1c6b8054e1
Venue: SIGMOD
Year: 2017
Pagerank: 7.300051e-05
Overall Rank: 3,420 | 77.08%
DOI: 10.1145/3035918.3054772

Incoming Non-self Citations Over Time

Authors

1. Ziawasch Abedjan (Technical University of Berlin)
2. Lukasz Golab (University of Waterloo)
3. Felix Naumann (Hasso Plattner Institute)

BibTeX Citation

@inproceedings{abedjan_sigmod17,
        title = {{Data Profiling – A Tutorial}},
        author = {Abedjan, Ziawasch and Golab, Lukasz and Naumann, Felix},
        series = {{SIGMOD} '17},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3035918.3054772},
        url = {https://dl.acm.org/doi/10.1145/3035918.3054772},
        year = {2017}
}

Incoming Citations (Sorted by Pagerank)

Showing 12 of 12 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
5,303	Fast Approximate Denial Constraint Discovery	2023	VLDB	6.1758652e-05
6,438	CtxPipe: Context-aware Data Preparation Pipeline Construction for Machine Learning	2024	SIGMOD	5.7678369e-05
6,877	Fast Incremental Discovery of Pointwise Order Dependencies	2020	VLDB	5.6429454e-05
7,972	The Power of Constraints in Natural Language to SQL Translation	2025	VLDB	5.3993508e-05
8,529	DataProf: Semantic Profiling for Iterative Data Cleansing and Business Rule Acquisition	2018	SIGMOD	5.3068634e-05
8,881	Rapidash: Efficient Detection of Constraint Violations	2024	VLDB	5.2442249e-05
9,571	GIO: Generating Efficient Matrix and Frame Readers for Custom Data Formats by Example	2023	SIGMOD	5.1430298e-05
9,842	CatDB: Data-catalog-guided, LLM-based Generation of Data-centric ML Pipelines	2025	VLDB	5.1064323e-05
10,096	Discovering Approximate Inclusion Dependencies	2025	VLDB	5.068372e-05
10,146	Efficient Differential Dependency Discovery	2024	VLDB	5.0597449e-05
11,318	Efficient Discovery of Relaxed Functional Dependencies	2025	VLDB	4.9605343e-05
12,017	INCA: Inconsistency-Aware Data Profiling and Querying	2021	SIGMOD	4.9605343e-05

Outgoing Citations (Sorted by Pagerank)

Showing 19 of 19 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
95	Potter's Wheel: An Interactive Data Cleaning System	2001	VLDB	0.00034319763
105	The MADlib Analytics Library or MAD Skills, the SQL	2012	VLDB	0.00033605348
160	CORDS: Automatic Discovery of Correlations and Soft Functional Dependencies	2004	SIGMOD	0.00027775994
348	Discovering Denial Constraints	2013	VLDB	0.00020216677
435	Mining Database Structure; Or, How to Build a Data Quality Browser	2002	SIGMOD	0.00018277436
512	Goods: Organizing Google's Datasets	2016	SIGMOD	0.00017036842
602	A Hybrid Approach to Functional Dependency Discovery	2016	SIGMOD	0.00015670535
972	The Data Civilizer System	2017	CIDR	0.00012742827
1,297	Extending Dependencies with Conditions	2007	VLDB	0.00011118907
1,399	Data Profiling with Metanome	2015	VLDB	0.0001076306
1,898	Sequential Dependencies	2009	VLDB	9.3965317e-05
1,979	Information-Theoretic Tools for Mining Database Structure from Large Data Sets	2004	SIGMOD	9.2615384e-05
4,245	Scalable Discovery of Unique Column Combinations	2014	VLDB	6.6958006e-05
4,264	Divide & Conquer-based Inclusion Dependency Discovery	2015	VLDB	6.6809569e-05
4,476	Effective and Complete Discovery of Order Dependencies via Set-based Axiomatization	2017	VLDB	6.5696859e-05
4,653	Temporal Rules Discovery for Web Data Cleaning	2016	VLDB	6.4706099e-05
4,741	Data Auditor: Exploring Data Quality and Semantics using Pattern Tableaux	2010	VLDB	6.4290861e-05
5,580	Challenges and Opportunities with Big Data	2012	VLDB	6.06071e-05
6,177	Fundamentals of Order Dependencies	2012	VLDB	5.8432596e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	2,930	Extracting and Analyzing Hidden Graphs from Relational Databases	2017	SIGMOD
2	5,485	Data Stream Query Processing: A Tutorial	2003	VLDB
3	1,394	Metadata Management for Large Statistical Databases	1982	VLDB
4	1,295	Querying and Mining Data Streams: You Only Get One Look	2002	SIGMOD
5	3,467	Automatic Discovery of Attributes in Relational Databases	2011	SIGMOD
6	8,531	Exploring the Data Wilderness through Examples	2019	SIGMOD
7	14,092	Bridging the Application and DBMS Divide Using Static Analysis and Dynamic Profiling	2009	SIGMOD
8	7,060	Towards NLP-Enhanced Data Profiling Tools	2022	CIDR
9	1,220	Overview of Data Exploration Techniques	2015	SIGMOD
10	1,399	Data Profiling with Metanome	2015	VLDB