Automatic Data Repair: Are We Ready to Deploy?

Summary: A taxonomy-driven study benchmarks 12 data-repair algorithms across 12 datasets, error conditions, and four downstream tasks using a practical error-reduction metric. A unified repair optimization strategy improves state-of-the-art methods, showing repair remains beneficial—even clean data is not the performance ceiling. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: hc719d94d97bd3a97
Venue: VLDB
Year: 2024
Pagerank: 7.4527106e-05
Overall Rank: 3,277 | 78.04%
DOI: 10.14778/3675034.3675051
PDF: Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

1. Wei Ni (City University of Hong Kong; Zhejiang University)
2. Xiaoye Miao (Zhejiang University)
3. Xiangyu Zhao (City University of Hong Kong)
4. Yangyang Wu (Zhejiang University)
5. Shuwei Liang (Zhejiang University)
6. Jianwei Yin (Zhejiang University)

BibTeX Citation

@article{ni_vldb24,
        title = {{Automatic Data Repair: Are We Ready to Deploy?}},
        author = {Ni, Wei and Miao, Xiaoye and Zhao, Xiangyu and Wu, Yangyang and Liang, Shuwei and Yin, Jianwei},
        journal = {PVLDB},
        series = {{VLDB} '24},
        volume = {17},
        number = {10},
        pages = {2617--2630},
        doi = {10.14778/3675034.3675051},
        url = {https://doi.org/10.14778/3675034.3675051},
        year = {2024}
}

Incoming Citations (Sorted by Pagerank)

Showing 9 of 9 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
9,912	Clean4TSDB: A Data Cleaning Tool for Time Series Databases	2024	VLDB	5.0983269e-05
10,431	Towards Scalable Visual Data Wrangling via Direct Manipulation	2026	CIDR	4.9605343e-05
10,606	Minimum Change ≠ Best Cleaning: Parallel and Incremental Error Detection under Integrity Constraints	2026	SIGMOD	4.9605343e-05
10,923	Auto-Fill: Learning to Predict Missing Values Accurately with Specialist Language Models	2026	VLDB	4.9605343e-05
11,121	Fault Lines: Benchmarking the Impact of Label Data Quality on ML Robustness and Fairness	2026	VLDB	4.9605343e-05
11,384	Federated Incomplete Tabular Data Prediction with Missing Complementarity	2025	VLDB	4.9605343e-05
11,413	UniClean: A Scalable Data Cleaning Solution for Mixed Errors based on Unified Cleaners and Optimized Cleaning Workflow	2025	VLDB	4.9605343e-05
11,461	DemandClean: A Multi-Objective Learning Framework for Balancing Model Tolerance to Data Authenticity and Diversity	2025	VLDB	4.9605343e-05
11,713	Generalizable Data Cleaning of Tabular Data in Latent Space	2024	VLDB	4.9605343e-05

Outgoing Citations (Sorted by Pagerank)

Showing 36 of 36 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
100	HoloClean: Holistic Data Repairs with Probabilistic Inference	2017	VLDB	0.00033951027
132	Deep Entity Matching with Pre-Trained Language Models	2021	VLDB	0.00030213215
158	Deep Learning for Entity Matching: A Design Space Exploration	2018	SIGMOD	0.00028049555
206	Declarative Data Cleaning: Language, Model, and Algorithms	2001	VLDB	0.00025121652
459	Distributed Representations of Tuples for Entity Resolution	2018	VLDB	0.00017863654
460	ActiveClean: Interactive Data Cleaning For Statistical Modeling	2016	VLDB	0.00017836918
569	Incremental Knowledge Base Construction Using DeepDive	2015	VLDB	0.00016212139
619	Reasoning about Record Matching Rules	2009	VLDB	0.00015503747
652	Don’t be SCAREd: Use SCalable Automatic REpairing with Maximal Likelihood and Bounded Changes	2013	SIGMOD	0.00015117165
727	Functional Dependency Discovery: An Experimental Evaluation of Seven Algorithms	2015	VLDB	0.00014426954
769	The LLUNATIC Data-Cleaning Framework	2013	VLDB	0.00014091996
853	HoloDetect: Few-Shot Learning for Error Detection	2019	SIGMOD	0.00013437314
886	Framework for Evaluating Clustering Algorithms in Duplicate Detection	2009	VLDB	0.00013215874
988	Towards Certain Fixes with Editing Rules and Master Data	2010	VLDB	0.00012643318
989	Data Cleaning: Overview and Emerging Challenges	2016	SIGMOD	0.00012638176
1,099	KATARA: A Data Cleaning System Powered by Knowledge Bases and Crowdsourcing	2015	SIGMOD	0.00012008783
1,306	Detecting Data Errors: Where are we and what needs to be done?	2016	VLDB	0.00011076619
1,347	Baran: Effective Error Correction via a Unified Context Representation and Transfer Learning	2020	VLDB	0.00010947547
1,533	A Data- and Workload-Aware Algorithm for Range Queries Under Differential Privacy	2014	VLDB	0.00010310932
1,627	Efficient Denial Constraint Discovery with Hydra	2018	VLDB	0.00010021689
1,731	Raha: A Configuration-Free Error Detection System	2019	SIGMOD	9.7585913e-05
1,980	Discovery of Approximate (and Exact) Denial Constraints	2020	VLDB	9.2527187e-05
2,053	Messing Up with BART: Error Generation for Evaluating Data-Cleaning Algorithms	2016	VLDB	9.1054597e-05
2,271	ZeroER: Entity Resolution using Zero Labeled Examples	2020	SIGMOD	8.7110698e-05
2,429	BigDansing: A System for Big Data Cleansing	2015	SIGMOD	8.4657925e-05
2,752	Uni-Detect: A Unified Approach to Automated Error Detection in Tables	2019	SIGMOD	8.0387193e-05
2,960	Auto-Detect: Data-Driven Error Detection in Tables	2018	SIGMOD	7.7967245e-05
3,372	Cleaning Denial Constraint Violations through Relaxation	2020	SIGMOD	7.3488827e-05
3,440	Efficient and Effective Data Imputation with Influence Functions	2022	VLDB	7.2791144e-05
3,680	Generating Concise Entity Matching Rules	2017	SIGMOD	7.0846793e-05
4,186	Data Integration and Machine Learning: A Natural Synergy	2018	SIGMOD	6.7408641e-05
4,369	Horizon: Scalable Dependency-driven Data Cleaning	2021	VLDB	6.6220109e-05
5,700	Analyzing How BERT Performs Entity Matching	2022	VLDB	6.0127959e-05
6,156	NADEEF: A Generalized Data Cleaning System	2013	VLDB	5.8539963e-05
9,345	VerifAI: Verified Generative AI	2024	CIDR	5.1769528e-05
9,733	Constraint-Variance Tolerant Data Repairing	2016	SIGMOD	5.1196037e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	11,713	Generalizable Data Cleaning of Tabular Data in Latent Space	2024	VLDB
2	2,785	Interaction between Record Matching and Data Repairing	2011	SIGMOD
3	652	Don’t be SCAREd: Use SCalable Automatic REpairing with Maximal Likelihood and Bounded Changes	2013	SIGMOD
4	9,733	Constraint-Variance Tolerant Data Repairing	2016	SIGMOD
5	6,327	Qualitative Data Cleaning	2016	VLDB
6	717	Guided Data Repair	2011	VLDB
7	1,306	Detecting Data Errors: Where are we and what needs to be done?	2016	VLDB
8	989	Data Cleaning: Overview and Emerging Challenges	2016	SIGMOD
9	527	Improving Data Quality: Consistency and Accuracy	2007	VLDB
10	2,958	Towards Dependable Data Repairing with Fixing Rules	2014	SIGMOD