A Data Quality Metric (DQM): How to Estimate the Number of Undetected Errors in Data Sets

Summary: Proposes Data Quality Metric (DQM) to quantify undetected errors after crowd-cleaning. Introduces FP/FN-resistant species estimators for distinct remaining errors under incomplete gold standards, with faster convergence across three real datasets. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 11396
Venue: VLDB
Year: 2017
Pagerank: 4.4039656e-05
Overall Rank: 9,056 | 37.00%
DOI: -

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 2 of 2 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,350	Northstar: An Interactive Data Science System	2018	VLDB	0.00012431059
11,454	Contextual Data Cleaning with Ontology FDs	2021	SIGMOD	4.1945683e-05

Outgoing Citations (Sorted by Pagerank)

Showing 14 of 14 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
59	Sampling-Based Estimation of the Number of Distinct Values of an Attribute	1995	VLDB	0.00064501896
94	CrowdDB: Answering Queries with Crowdsourcing	2011	SIGMOD	0.00051013264
263	CrowdER: Crowdsourcing Entity Resolution	2012	VLDB	0.00029862413
265	A Cost-Based Model and Effective Heuristic for Repairing Constraints by Value Modification	2005	SIGMOD	0.00029763412
623	Improving Data Quality: Consistency and Accuracy	2007	VLDB	0.00018996374
643	Corleone: Hands-Off Crowdsourcing for Entity Matching	2014	SIGMOD	0.00018754451
814	Entity Resolution: Theory, Practice & Open Challenges	2012	VLDB	0.00016370594
833	Guided Data Repair	2011	VLDB	0.00016138432
1,612	Detecting Data Errors: Where are we and what needs to be done?	2016	VLDB	0.00011142794
1,627	Data Cleaning: Overview and Emerging Challenges	2016	SIGMOD	0.00011086905
2,184	A Sample-and-Clean Framework for Fast and Accurate Query Processing on Dirty Data	2014	SIGMOD	9.3429789e-05
2,722	Progressive Approach to Relational Entity Resolution	2014	VLDB	8.2338356e-05
4,383	Incremental Record Linkage	2014	VLDB	6.2383094e-05
6,941	Estimating the Impact of Unknown Unknowns on Aggregate Query Results	2016	SIGMOD	4.8924e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
13,232	Data Cleaning in the Era of Data Science: Challenges and Opportunities	2021	CIDR	-
2,460	Combining Quantitative and Logical Data Cleaning	2016	VLDB	8.7617484e-05
5,660	Descriptive and Prescriptive Data Cleaning	2014	SIGMOD	5.3847321e-05
10,512	Auto-Test: Learning Semantic-Domain Constraints for Unsupervised Error Detection in Tables	2025	SIGMOD	4.1945683e-05
3,396	Automatic Data Repair: Are We Ready to Deploy?	2024	VLDB	7.1455126e-05
2,018	Statistical Distortion: Consequences of Data Cleaning	2012	VLDB	9.7764643e-05
7,013	Qualitative Data Cleaning	2016	VLDB	4.8619024e-05
507	Data Quality and Data Cleaning: An Overview	2003	SIGMOD	0.00021473263
1,627	Data Cleaning: Overview and Emerging Challenges	2016	SIGMOD	0.00011086905
1,612	Detecting Data Errors: Where are we and what needs to be done?	2016	VLDB	0.00011142794