Automatic Data Repair: Are We Ready to Deploy?

Summary: A taxonomy-driven study benchmarks 12 data-repair algorithms across 12 datasets, error conditions, and four downstream tasks using a practical error-reduction metric. A unified repair optimization strategy improves state-of-the-art methods, showing repair remains beneficial—even clean data is not the performance ceiling. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: hc719d94d97bd3a97
Venue: VLDB
Year: 2024
Pagerank: 7.4809771e-05
Overall Rank: 3,263 | 78.07%
DOI: 10.14778/3675034.3675051

Incoming Non-self Citations Over Time

Authors

1. Wei Ni (City University of Hong Kong; Zhejiang University)
2. Xiaoye Miao (Zhejiang University)
3. Xiangyu Zhao (City University of Hong Kong)
4. Yangyang Wu (Zhejiang University)
5. Shuwei Liang (Zhejiang University)
6. Jianwei Yin (Zhejiang University)

BibTeX Citation

@article{ni_vldb24,
        title = {{Automatic Data Repair: Are We Ready to Deploy?}},
        author = {Ni, Wei and Miao, Xiaoye and Zhao, Xiangyu and Wu, Yangyang and Liang, Shuwei and Yin, Jianwei},
        journal = {PVLDB},
        series = {{VLDB} '24},
        volume = {17},
        number = {10},
        pages = {2617--2630},
        doi = {10.14778/3675034.3675051},
        url = {https://doi.org/10.14778/3675034.3675051},
        year = {2024}
}

Incoming Citations (Sorted by Pagerank)

Showing 9 of 9 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
9,872	Clean4TSDB: A Data Cleaning Tool for Time Series Databases	2024	VLDB	5.1176637e-05
10,352	Towards Scalable Visual Data Wrangling via Direct Manipulation	2026	CIDR	4.9793485e-05
10,529	Minimum Change ≠ Best Cleaning: Parallel and Incremental Error Detection under Integrity Constraints	2026	SIGMOD	4.9793485e-05
10,853	Auto-Fill: Learning to Predict Missing Values Accurately with Specialist Language Models	2026	VLDB	4.9793485e-05
11,051	Fault Lines: Benchmarking the Impact of Label Data Quality on ML Robustness and Fairness	2026	VLDB	4.9793485e-05
11,322	Federated Incomplete Tabular Data Prediction with Missing Complementarity	2025	VLDB	4.9793485e-05
11,353	UniClean: A Scalable Data Cleaning Solution for Mixed Errors based on Unified Cleaners and Optimized Cleaning Workflow	2025	VLDB	4.9793485e-05
11,402	DemandClean: A Multi-Objective Learning Framework for Balancing Model Tolerance to Data Authenticity and Diversity	2025	VLDB	4.9793485e-05
11,661	Generalizable Data Cleaning of Tabular Data in Latent Space	2024	VLDB	4.9793485e-05

Outgoing Citations (Sorted by Pagerank)

Showing 36 of 36 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
104	HoloClean: Holistic Data Repairs with Probabilistic Inference	2017	VLDB	0.00033690989
134	Deep Entity Matching with Pre-Trained Language Models	2021	VLDB	0.00030043481
158	Deep Learning for Entity Matching: A Design Space Exploration	2018	SIGMOD	0.00028046388
204	Declarative Data Cleaning: Language, Model, and Algorithms	2001	VLDB	0.00025190386
457	Distributed Representations of Tuples for Entity Resolution	2018	VLDB	0.00017907103
483	ActiveClean: Interactive Data Cleaning For Statistical Modeling	2016	VLDB	0.00017590977
579	Incremental Knowledge Base Construction Using DeepDive	2015	VLDB	0.00016086569
618	Reasoning about Record Matching Rules	2009	VLDB	0.00015536912
652	Don’t be SCAREd: Use SCalable Automatic REpairing with Maximal Likelihood and Bounded Changes	2013	SIGMOD	0.00015121325
727	Functional Dependency Discovery: An Experimental Evaluation of Seven Algorithms	2015	VLDB	0.00014443394
767	The LLUNATIC Data-Cleaning Framework	2013	VLDB	0.00014114806
883	HoloDetect: Few-Shot Learning for Error Detection	2019	SIGMOD	0.00013268059
885	Framework for Evaluating Clustering Algorithms in Duplicate Detection	2009	VLDB	0.00013260551
989	Towards Certain Fixes with Editing Rules and Master Data	2010	VLDB	0.0001265344
1,043	Data Cleaning: Overview and Emerging Challenges	2016	SIGMOD	0.00012335114
1,099	KATARA: A Data Cleaning System Powered by Knowledge Bases and Crowdsourcing	2015	SIGMOD	0.00012037058
1,342	Baran: Effective Error Correction via a Unified Context Representation and Transfer Learning	2020	VLDB	0.00010968223
1,344	Detecting Data Errors: Where are we and what needs to be done?	2016	VLDB	0.00010956518
1,528	A Data- and Workload-Aware Algorithm for Range Queries Under Differential Privacy	2014	VLDB	0.00010349919
1,619	Efficient Denial Constraint Discovery with Hydra	2018	VLDB	0.00010055625
1,805	Raha: A Configuration-Free Error Detection System	2019	SIGMOD	9.59842e-05
1,971	Discovery of Approximate (and Exact) Denial Constraints	2020	VLDB	9.2873596e-05
2,051	Messing Up with BART: Error Generation for Evaluating Data-Cleaning Algorithms	2016	VLDB	9.1199511e-05
2,323	ZeroER: Entity Resolution using Zero Labeled Examples	2020	SIGMOD	8.6348884e-05
2,423	BigDansing: A System for Big Data Cleansing	2015	SIGMOD	8.4877894e-05
2,748	Uni-Detect: A Unified Approach to Automated Error Detection in Tables	2019	SIGMOD	8.0610697e-05
2,960	Auto-Detect: Data-Driven Error Detection in Tables	2018	SIGMOD	7.8075103e-05
3,360	Cleaning Denial Constraint Violations through Relaxation	2020	SIGMOD	7.3767115e-05
3,441	Efficient and Effective Data Imputation with Influence Functions	2022	VLDB	7.2980777e-05
3,681	Generating Concise Entity Matching Rules	2017	SIGMOD	7.1014441e-05
4,171	Data Integration and Machine Learning: A Natural Synergy	2018	SIGMOD	6.7608137e-05
4,347	Horizon: Scalable Dependency-driven Data Cleaning	2021	VLDB	6.6469984e-05
5,705	Analyzing How BERT Performs Entity Matching	2022	VLDB	6.0295759e-05
6,152	NADEEF: A Generalized Data Cleaning System	2013	VLDB	5.8693135e-05
9,311	VerifAI: Verified Generative AI	2024	CIDR	5.1965878e-05
9,696	Constraint-Variance Tolerant Data Repairing	2016	SIGMOD	5.1389775e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	4,998	Descriptive and Prescriptive Data Cleaning	2014	SIGMOD
2	2,784	Interaction between Record Matching and Data Repairing	2011	SIGMOD
3	652	Don’t be SCAREd: Use SCalable Automatic REpairing with Maximal Likelihood and Bounded Changes	2013	SIGMOD
4	9,696	Constraint-Variance Tolerant Data Repairing	2016	SIGMOD
5	6,381	Qualitative Data Cleaning	2016	VLDB
6	716	Guided Data Repair	2011	VLDB
7	1,344	Detecting Data Errors: Where are we and what needs to be done?	2016	VLDB
8	1,043	Data Cleaning: Overview and Emerging Challenges	2016	SIGMOD
9	526	Improving Data Quality: Consistency and Accuracy	2007	VLDB
10	2,964	Towards Dependable Data Repairing with Fixing Rules	2014	SIGMOD