A Data Quality Metric (DQM): How to Estimate the Number of Undetected Errors in Data Sets

Summary: Proposes Data Quality Metric (DQM) to quantify undetected errors after crowd-cleaning. Introduces FP/FN-resistant species estimators for distinct remaining errors under incomplete gold standards, with faster convergence across three real datasets. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 11584
Venue: VLDB
Year: 2017
Pagerank: 5.3058708e-05
Overall Rank: 9,206 | 36.84%
DOI: 10.14778/3115404.3115414

Incoming Non-self Citations Over Time

Authors

1. Yeounoh Chung (Brown University)
2. Sanjay Krishnan (University of California Berkeley)
3. Tim Kraska (Brown University)

BibTeX Citation

@article{chung_vldb17,
        title = {{A Data Quality Metric (DQM): How to Estimate the Number of Undetected Errors in Data Sets}},
        author = {Chung, Yeounoh and Krishnan, Sanjay and Kraska, Tim},
        journal = {PVLDB},
        series = {{VLDB} '17},
        volume = {10},
        number = {11},
        pages = {1094},
        doi = {10.14778/3115404.3115414},
        url = {https://doi.org/10.14778/3115404.3115414},
        year = {2017}
}

Incoming Citations (Sorted by Pagerank)

Showing 2 of 2 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,392	Northstar: An Interactive Data Science System	2018	VLDB	0.00010936065
11,652	Contextual Data Cleaning with Ontology FDs	2021	SIGMOD	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 14 of 14 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
75	Sampling-Based Estimation of the Number of Distinct Values of an Attribute	1995	VLDB	0.00037277061
90	CrowdDB: Answering Queries with Crowdsourcing	2011	SIGMOD	0.00034951786
185	A Cost-Based Model and Effective Heuristic for Repairing Constraints by Value Modification	2005	SIGMOD	0.00026231189
196	CrowdER: Crowdsourcing Entity Resolution	2012	VLDB	0.00025780596
439	Corleone: Hands-Off Crowdsourcing for Entity Matching	2014	SIGMOD	0.00018464913
533	Improving Data Quality: Consistency and Accuracy	2007	VLDB	0.0001705859
626	Entity Resolution: Theory, Practice & Open Challenges	2012	VLDB	0.00015656958
714	Guided Data Repair	2011	VLDB	0.00014662041
1,323	Data Cleaning: Overview and Emerging Challenges	2016	SIGMOD	0.00011152602
1,351	Detecting Data Errors: Where are we and what needs to be done?	2016	VLDB	0.00011064851
1,736	A Sample-and-Clean Framework for Fast and Accurate Query Processing on Dirty Data	2014	SIGMOD	9.8984415e-05
2,711	Progressive Approach to Relational Entity Resolution	2014	VLDB	8.2178865e-05
3,916	Incremental Record Linkage	2014	VLDB	7.0185679e-05
6,819	Estimating the Impact of Unknown Unknowns on Aggregate Query Results	2016	SIGMOD	5.7635226e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	13,435	Data Cleaning in the Era of Data Science: Challenges and Opportunities	2021	CIDR
2	2,041	Combining Quantitative and Logical Data Cleaning	2016	VLDB
3	4,890	Descriptive and Prescriptive Data Cleaning	2014	SIGMOD
4	10,785	Auto-Test: Learning Semantic-Domain Constraints for Unsupervised Error Detection in Tables	2025	SIGMOD
5	3,580	Automatic Data Repair: Are We Ready to Deploy?	2024	VLDB
6	1,914	Statistical Distortion: Consequences of Data Cleaning	2012	VLDB
7	6,392	Qualitative Data Cleaning	2016	VLDB
8	1,484	Data Quality and Data Cleaning: An Overview	2003	SIGMOD
9	1,323	Data Cleaning: Overview and Emerging Challenges	2016	SIGMOD
10	1,351	Detecting Data Errors: Where are we and what needs to be done?	2016	VLDB