Statistical Distortion: Consequences of Data Cleaning

Summary: Introduces statistical distortion as a metric for data cleaning impact. A scalable experimental framework evaluates glitch improvement, statistical distortion, and cost, addressing gaps in existing metrics; demonstrated on real-world data. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 10589
Venue: VLDB
Year: 2012
Pagerank: 9.4886927e-05
Overall Rank: 1,914 | 86.87%
DOI: 10.14778/2350229.2350276

Incoming Non-self Citations Over Time

Authors

1. Tamraparni Dasu (AT&T)
2. Ji Meng Loh (AT&T)

BibTeX Citation

@article{dasu_vldb12,
        title = {{Statistical Distortion: Consequences of Data Cleaning}},
        author = {Dasu, Tamraparni and Loh, Ji Meng},
        journal = {PVLDB},
        series = {{VLDB} '12},
        volume = {5},
        number = {11},
        pages = {1674--1683},
        doi = {10.14778/2350229.2350276},
        url = {https://doi.org/10.14778/2350229.2350276},
        year = {2012}
}

Incoming Citations (Sorted by Pagerank)

Showing 11 of 11 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
420	Can Foundation Models Wrangle Your Data?	2023	VLDB	0.00018789852
946	HoloDetect: Few-Shot Learning for Error Detection	2019	SIGMOD	0.00013054126
1,351	Detecting Data Errors: Where are we and what needs to be done?	2016	VLDB	0.00011064851
2,041	Combining Quantitative and Logical Data Cleaning	2016	VLDB	9.2692538e-05
4,994	Sequential Data Cleaning: A Statistical Approach	2016	SIGMOD	6.4092706e-05
5,407	Earth Mover’s Distance based Similarity Search at Scale	2014	VLDB	6.2281449e-05
6,154	Multivariate Time Series Cleaning under Speed Constraints	2024	SIGMOD	5.9567243e-05
6,352	OTClean: Data Cleaning for Conditional Independence Violations using Optimal Transport	2024	SIGMOD	5.9042757e-05
7,179	CleanM: An Optimizable Query Language for Unified Scale-Out Data Cleaning	2017	VLDB	5.6802479e-05
10,784	The Best of Both Worlds: On Repairing Timestamps and Attribute Values for Multivariate Time Series	2025	SIGMOD	5.093636e-05
13,584	FIT to Monitor Feed Quality	2015	VLDB	-

Outgoing Citations (Sorted by Pagerank)

Showing 3 of 3 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
549	ERACER: A Database Approach for Statistical Inference and Data Cleaning	2010	SIGMOD	0.00016692839
3,052	Online Data Fusion	2011	VLDB	7.8105426e-05
4,059	GDR: A System for Guided Data Repair	2010	SIGMOD	6.9330647e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	2,041	Combining Quantitative and Logical Data Cleaning	2016	VLDB
2	11,343	Generalizable Data Cleaning of Tabular Data in Latent Space	2024	VLDB
3	9,206	A Data Quality Metric (DQM): How to Estimate the Number of Undetected Errors in Data Sets	2017	VLDB
4	10,322	Minimum Change ≠ Best Cleaning: Parallel and Incremental Error Detection under Integrity Constraints	2026	SIGMOD
5	13,435	Data Cleaning in the Era of Data Science: Challenges and Opportunities	2021	CIDR
6	3,580	Automatic Data Repair: Are We Ready to Deploy?	2024	VLDB
7	1,484	Data Quality and Data Cleaning: An Overview	2003	SIGMOD
8	1,351	Detecting Data Errors: Where are we and what needs to be done?	2016	VLDB
9	6,392	Qualitative Data Cleaning	2016	VLDB
10	1,323	Data Cleaning: Overview and Emerging Challenges	2016	SIGMOD