A Data Quality Metric (DQM): How to Estimate the Number of Undetected Errors in Data Sets

Summary: Proposes Data Quality Metric (DQM) to quantify undetected errors after crowd-cleaning. Introduces FP/FN-resistant species estimators for distinct remaining errors under incomplete gold standards, with faster convergence across three real datasets. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 11397
Venue: VLDB
Year: 2017
Pagerank: 4.3997447e-05
Overall Rank: 9,055 | 37.07%
DOI: -

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 2 of 2 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,354	Northstar: An Interactive Data Science System	2018	VLDB	0.00012424105
11,457	Contextual Data Cleaning with Ontology FDs	2021	SIGMOD	4.1905499e-05

Outgoing Citations (Sorted by Pagerank)

Showing 14 of 14 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
60	Sampling-Based Estimation of the Number of Distinct Values of an Attribute	1995	VLDB	0.00064450997
94	CrowdDB: Answering Queries with Crowdsourcing	2011	SIGMOD	0.00051273089
265	CrowdER: Crowdsourcing Entity Resolution	2012	VLDB	0.00029904018
268	A Cost-Based Model and Effective Heuristic for Repairing Constraints by Value Modification	2005	SIGMOD	0.00029739054
621	Improving Data Quality: Consistency and Accuracy	2007	VLDB	0.00018978331
641	Corleone: Hands-Off Crowdsourcing for Entity Matching	2014	SIGMOD	0.00018759417
799	Entity Resolution: Theory, Practice & Open Challenges	2012	VLDB	0.00016479804
830	Guided Data Repair	2011	VLDB	0.00016125759
1,403	Detecting Data Errors: Where are we and what needs to be done?	2016	VLDB	0.00012180046
1,629	Data Cleaning: Overview and Emerging Challenges	2016	SIGMOD	0.00011073148
2,177	A Sample-and-Clean Framework for Fast and Accurate Query Processing on Dirty Data	2014	SIGMOD	9.371335e-05
2,725	Progressive Approach to Relational Entity Resolution	2014	VLDB	8.2268045e-05
4,380	Incremental Record Linkage	2014	VLDB	6.2325868e-05
6,943	Estimating the Impact of Unknown Unknowns on Aggregate Query Results	2016	SIGMOD	4.8876509e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
13,245	Data Cleaning in the Era of Data Science: Challenges and Opportunities	2021	CIDR	-
2,417	Combining Quantitative and Logical Data Cleaning	2016	VLDB	8.8502556e-05
5,671	Descriptive and Prescriptive Data Cleaning	2014	SIGMOD	5.3797808e-05
10,521	Auto-Test: Learning Semantic-Domain Constraints for Unsupervised Error Detection in Tables	2025	SIGMOD	4.1905499e-05
3,397	Automatic Data Repair: Are We Ready to Deploy?	2024	VLDB	7.1386386e-05
1,975	Statistical Distortion: Consequences of Data Cleaning	2012	VLDB	9.881077e-05
7,013	Qualitative Data Cleaning	2016	VLDB	4.8576683e-05
508	Data Quality and Data Cleaning: An Overview	2003	SIGMOD	0.00021473523
1,629	Data Cleaning: Overview and Emerging Challenges	2016	SIGMOD	0.00011073148
1,403	Detecting Data Errors: Where are we and what needs to be done?	2016	VLDB	0.00012180046