Automatic Data Repair: Are We Ready to Deploy?

Summary: A taxonomy-driven study benchmarks 12 data-repair algorithms across 12 datasets, error conditions, and four downstream tasks using a practical error-reduction metric. A unified repair optimization strategy improves state-of-the-art methods, showing repair remains beneficial—even clean data is not the performance ceiling. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: hc719d94d97bd3a97
Venue: VLDB
Year: 2024
Pagerank: 7.4774357e-05
Overall Rank: 3,264 | 78.07%
DOI: 10.14778/3675034.3675051
PDF: Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

1. Wei Ni (City University of Hong Kong; Zhejiang University)
2. Xiaoye Miao (Zhejiang University)
3. Xiangyu Zhao (City University of Hong Kong)
4. Yangyang Wu (Zhejiang University)
5. Shuwei Liang (Zhejiang University)
6. Jianwei Yin (Zhejiang University)

BibTeX Citation

@article{ni_vldb24,
        title = {{Automatic Data Repair: Are We Ready to Deploy?}},
        author = {Ni, Wei and Miao, Xiaoye and Zhao, Xiangyu and Wu, Yangyang and Liang, Shuwei and Yin, Jianwei},
        journal = {PVLDB},
        series = {{VLDB} '24},
        volume = {17},
        number = {10},
        pages = {2617--2630},
        doi = {10.14778/3675034.3675051},
        url = {https://doi.org/10.14778/3675034.3675051},
        year = {2024}
}

Incoming Citations (Sorted by Pagerank)

Showing 9 of 9 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
9,879	Clean4TSDB: A Data Cleaning Tool for Time Series Databases	2024	VLDB	5.115241e-05
10,364	Towards Scalable Visual Data Wrangling via Direct Manipulation	2026	CIDR	4.9769913e-05
10,540	Minimum Change ≠ Best Cleaning: Parallel and Incremental Error Detection under Integrity Constraints	2026	SIGMOD	4.9769913e-05
10,862	Auto-Fill: Learning to Predict Missing Values Accurately with Specialist Language Models	2026	VLDB	4.9769913e-05
11,060	Fault Lines: Benchmarking the Impact of Label Data Quality on ML Robustness and Fairness	2026	VLDB	4.9769913e-05
11,330	Federated Incomplete Tabular Data Prediction with Missing Complementarity	2025	VLDB	4.9769913e-05
11,360	UniClean: A Scalable Data Cleaning Solution for Mixed Errors based on Unified Cleaners and Optimized Cleaning Workflow	2025	VLDB	4.9769913e-05
11,408	DemandClean: A Multi-Objective Learning Framework for Balancing Model Tolerance to Data Authenticity and Diversity	2025	VLDB	4.9769913e-05
11,667	Generalizable Data Cleaning of Tabular Data in Latent Space	2024	VLDB	4.9769913e-05

Outgoing Citations (Sorted by Pagerank)

Showing 36 of 36 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
104	HoloClean: Holistic Data Repairs with Probabilistic Inference	2017	VLDB	0.00033676943
134	Deep Entity Matching with Pre-Trained Language Models	2021	VLDB	0.00030042569
158	Deep Learning for Entity Matching: A Design Space Exploration	2018	SIGMOD	0.00028038831
204	Declarative Data Cleaning: Language, Model, and Algorithms	2001	VLDB	0.00025179068
457	Distributed Representations of Tuples for Entity Resolution	2018	VLDB	0.00017899824
483	ActiveClean: Interactive Data Cleaning For Statistical Modeling	2016	VLDB	0.00017584249
579	Incremental Knowledge Base Construction Using DeepDive	2015	VLDB	0.00016083582
618	Reasoning about Record Matching Rules	2009	VLDB	0.0001553004
652	Don’t be SCAREd: Use SCalable Automatic REpairing with Maximal Likelihood and Bounded Changes	2013	SIGMOD	0.00015114401
728	Functional Dependency Discovery: An Experimental Evaluation of Seven Algorithms	2015	VLDB	0.00014436728
767	The LLUNATIC Data-Cleaning Framework	2013	VLDB	0.00014108234
884	HoloDetect: Few-Shot Learning for Error Detection	2019	SIGMOD	0.00013263269
885	Framework for Evaluating Clustering Algorithms in Duplicate Detection	2009	VLDB	0.00013254509
989	Towards Certain Fixes with Editing Rules and Master Data	2010	VLDB	0.00012647631
1,044	Data Cleaning: Overview and Emerging Challenges	2016	SIGMOD	0.00012329478
1,098	KATARA: A Data Cleaning System Powered by Knowledge Bases and Crowdsourcing	2015	SIGMOD	0.00012031983
1,342	Baran: Effective Error Correction via a Unified Context Representation and Transfer Learning	2020	VLDB	0.00010963254
1,344	Detecting Data Errors: Where are we and what needs to be done?	2016	VLDB	0.00010951939
1,530	A Data- and Workload-Aware Algorithm for Range Queries Under Differential Privacy	2014	VLDB	0.00010345019
1,620	Efficient Denial Constraint Discovery with Hydra	2018	VLDB	0.00010050865
1,805	Raha: A Configuration-Free Error Detection System	2019	SIGMOD	9.5938877e-05
1,972	Discovery of Approximate (and Exact) Denial Constraints	2020	VLDB	9.2829634e-05
2,054	Messing Up with BART: Error Generation for Evaluating Data-Cleaning Algorithms	2016	VLDB	9.1158071e-05
2,325	ZeroER: Entity Resolution using Zero Labeled Examples	2020	SIGMOD	8.6308459e-05
2,424	BigDansing: A System for Big Data Cleansing	2015	SIGMOD	8.483813e-05
2,748	Uni-Detect: A Unified Approach to Automated Error Detection in Tables	2019	SIGMOD	8.0572603e-05
2,962	Auto-Detect: Data-Driven Error Detection in Tables	2018	SIGMOD	7.8038782e-05
3,360	Cleaning Denial Constraint Violations through Relaxation	2020	SIGMOD	7.3732195e-05
3,441	Efficient and Effective Data Imputation with Influence Functions	2022	VLDB	7.2946229e-05
3,684	Generating Concise Entity Matching Rules	2017	SIGMOD	7.0983735e-05
4,171	Data Integration and Machine Learning: A Natural Synergy	2018	SIGMOD	6.7576159e-05
4,348	Horizon: Scalable Dependency-driven Data Cleaning	2021	VLDB	6.6438522e-05
5,706	Analyzing How BERT Performs Entity Matching	2022	VLDB	6.0267215e-05
6,154	NADEEF: A Generalized Data Cleaning System	2013	VLDB	5.8665355e-05
9,320	VerifAI: Verified Generative AI	2024	CIDR	5.1941278e-05
9,702	Constraint-Variance Tolerant Data Repairing	2016	SIGMOD	5.1365447e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	11,667	Generalizable Data Cleaning of Tabular Data in Latent Space	2024	VLDB
2	2,784	Interaction between Record Matching and Data Repairing	2011	SIGMOD
3	652	Don’t be SCAREd: Use SCalable Automatic REpairing with Maximal Likelihood and Bounded Changes	2013	SIGMOD
4	9,702	Constraint-Variance Tolerant Data Repairing	2016	SIGMOD
5	6,384	Qualitative Data Cleaning	2016	VLDB
6	716	Guided Data Repair	2011	VLDB
7	1,344	Detecting Data Errors: Where are we and what needs to be done?	2016	VLDB
8	1,044	Data Cleaning: Overview and Emerging Challenges	2016	SIGMOD
9	526	Improving Data Quality: Consistency and Accuracy	2007	VLDB
10	2,967	Towards Dependable Data Repairing with Fixing Rules	2014	SIGMOD