Statistical Distortion: Consequences of Data Cleaning

Summary: Introduces statistical distortion as a metric for data cleaning impact. A scalable experimental framework evaluates glitch improvement, statistical distortion, and cost, addressing gaps in existing metrics; demonstrated on real-world data. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h270b4de4bdab82ac
Venue: VLDB
Year: 2012
Pagerank: 9.3878613e-05
Overall Rank: 1,914 | 87.14%
DOI: 10.14778/2350229.2350276

Incoming Non-self Citations Over Time

Authors

1. Tamraparni Dasu (AT&T)
2. Ji Meng Loh (AT&T)

BibTeX Citation

@article{dasu_vldb12,
        title = {{Statistical Distortion: Consequences of Data Cleaning}},
        author = {Dasu, Tamraparni and Loh, Ji Meng},
        journal = {PVLDB},
        series = {{VLDB} '12},
        volume = {5},
        number = {11},
        pages = {1674--1683},
        doi = {10.14778/2350229.2350276},
        url = {https://doi.org/10.14778/2350229.2350276},
        year = {2012}
}

Incoming Citations (Sorted by Pagerank)

Showing 11 of 11 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
329	Can Foundation Models Wrangle Your Data?	2023	VLDB	0.00020858443
883	HoloDetect: Few-Shot Learning for Error Detection	2019	SIGMOD	0.00013268059
1,344	Detecting Data Errors: Where are we and what needs to be done?	2016	VLDB	0.00010956518
2,055	Combining Quantitative and Logical Data Cleaning	2016	VLDB	9.1128336e-05
5,107	Sequential Data Cleaning: A Statistical Approach	2016	SIGMOD	6.2701436e-05
5,533	Earth Mover’s Distance based Similarity Search at Scale	2014	VLDB	6.0923371e-05
6,285	Multivariate Time Series Cleaning under Speed Constraints	2024	SIGMOD	5.8230714e-05
6,480	OTClean: Data Cleaning for Conditional Independence Violations using Optimal Transport	2024	SIGMOD	5.7717996e-05
7,298	CleanM: An Optimizable Query Language for Unified Scale-Out Data Cleaning	2017	VLDB	5.561054e-05
11,201	The Best of Both Worlds: On Repairing Timestamps and Attribute Values for Multivariate Time Series	2025	SIGMOD	4.9793485e-05
13,897	FIT to Monitor Feed Quality	2015	VLDB	-

Outgoing Citations (Sorted by Pagerank)

Showing 3 of 3 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
547	ERACER: A Database Approach for Statistical Inference and Data Cleaning	2010	SIGMOD	0.00016578131
3,079	Online Data Fusion	2011	VLDB	7.6698103e-05
4,127	GDR: A System for Guided Data Repair	2010	SIGMOD	6.791747e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	2,055	Combining Quantitative and Logical Data Cleaning	2016	VLDB
2	11,661	Generalizable Data Cleaning of Tabular Data in Latent Space	2024	VLDB
3	9,385	A Data Quality Metric (DQM): How to Estimate the Number of Undetected Errors in Data Sets	2017	VLDB
4	10,529	Minimum Change ≠ Best Cleaning: Parallel and Incremental Error Detection under Integrity Constraints	2026	SIGMOD
5	13,749	Data Cleaning in the Era of Data Science: Challenges and Opportunities	2021	CIDR
6	3,263	Automatic Data Repair: Are We Ready to Deploy?	2024	VLDB
7	1,509	Data Quality and Data Cleaning: An Overview	2003	SIGMOD
8	1,344	Detecting Data Errors: Where are we and what needs to be done?	2016	VLDB
9	6,381	Qualitative Data Cleaning	2016	VLDB
10	1,043	Data Cleaning: Overview and Emerging Challenges	2016	SIGMOD