DBScholar

Back to papers

Detecting Data Errors: Where are we and what needs to be done?

Summary: Empirical study: data-cleaning tools miss large portions of real-world errors and have robustness gaps. Proposes multi-tool workflow to boost coverage with less verification; notes domain-specific tools and enrichment, but some errors remain undetectable. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
hf589acc29fcb027c
Venue
VLDB
Year
2016
Pagerank
0.00010951939
Overall Rank
1,344 | 90.97%
DOI
10.14778/2994509.2994518
PDF
Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{abedjan_vldb16,
        title = {{Detecting Data Errors: Where are we and what needs to be done?}},
        author = {Abedjan, Ziawasch and Chu, Xu and Deng, Dong and Fernandez, Raul Castro and Ilyas, Ihab F. and Ouzzani, Mourad and Papotti, Paolo and Stonebraker, Michael and Tang, Nan},
        journal = {PVLDB},
        series = {{VLDB} '16},
        volume = {9},
        number = {12},
        pages = {993--1004},
        doi = {10.14778/2994509.2994518},
        url = {https://doi.org/10.14778/2994509.2994518},
        year = {2016}
}

Incoming Citations (Sorted by Pagerank)

Showing 50 of 50 citing papers.

Rank Citing Paper Year Venue Pagerank
104 HoloClean: Holistic Data Repairs with Probabilistic Inference 2017 VLDB 0.00033676943
329 Can Foundation Models Wrangle Your Data? 2023 VLDB 0.00020867521
884 HoloDetect: Few-Shot Learning for Error Detection 2019 SIGMOD 0.00013263269
972 The Data Civilizer System 2017 CIDR 0.00012757732
1,342 Baran: Effective Error Correction via a Unified Context Representation and Transfer Learning 2020 VLDB 0.00010963254
1,391 Creating Embeddings of Heterogeneous Relational Datasets for Data Integration Tasks 2020 SIGMOD 0.00010812249
1,493 Synthesizing Entity Matching Rules by Examples 2018 VLDB 0.00010500948
1,805 Raha: A Configuration-Free Error Detection System 2019 SIGMOD 9.5938877e-05
1,993 RPT: Relational Pre-trained Transformer Is Almost All You Need towards Democratizing Data Preparation 2021 VLDB 9.2348951e-05
2,372 SCODED: Statistical Constraint Oriented Data Error Detection 2020 SIGMOD 8.5575299e-05
2,600 Complaint-driven Training Data Debugging for Query 2.0 2020 SIGMOD 8.2346824e-05
2,642 Auto-Suggest: Learning-to-Recommend Data Preparation Steps Using Data Science Notebooks 2020 SIGMOD 8.1751637e-05
2,748 Uni-Detect: A Unified Approach to Automated Error Detection in Tables 2019 SIGMOD 8.0572603e-05
2,962 Auto-Detect: Data-Driven Error Detection in Tables 2018 SIGMOD 7.8038782e-05
3,264 Automatic Data Repair: Are We Ready to Deploy? 2024 VLDB 7.4774357e-05
3,421 UGuide – User-Guided Discovery of FD-Detectable Errors 2017 SIGMOD 7.3120636e-05
4,426 Auto-Transform: Learning-to-Transform by Patterns 2020 VLDB 6.601896e-05
4,525 DiffPrep: Differentiable Data Preprocessing Pipeline Search for Learning over Tabular Data 2023 SIGMOD 6.559044e-05
4,829 QFix: Diagnosing Errors through Query Histories 2017 SIGMOD 6.3887613e-05
4,845 Pattern Functional Dependencies for Data Cleaning 2020 VLDB 6.3808938e-05
4,955 Adaptive Data Augmentation for Supervised Learning over Missing Data 2021 VLDB 6.3386868e-05
5,393 SchemaPile: A Large Collection of Relational Database Schemas 2024 SIGMOD 6.1494131e-05
5,645 Self-supervised and Interpretable Data Cleaning with Sequence Generative Adversarial Networks 2023 VLDB 6.0509471e-05
5,866 Properties of Inconsistency Measures for Databases 2021 SIGMOD 5.96357e-05
5,956 Semi-Supervised Data Cleaning with Raha and Baran 2021 CIDR 5.9329823e-05
6,048 Your notebook is not crumby enough, REPLace it 2020 CIDR 5.9024167e-05
6,924 CtxPipe: Context-aware Data Preparation Pipeline Construction for Machine Learning 2024 SIGMOD 5.6405901e-05
7,467 Time Series Data Validity 2023 SIGMOD 5.5178324e-05
7,538 PIClean: A Probabilistic and Interactive Data Cleaning System 2019 SIGMOD 5.4981956e-05
7,589 Data Imputation with Limited Data Redundancy Using Data Lakes 2025 VLDB 5.4880216e-05
7,854 CoClean: Collaborative Data Cleaning 2020 SIGMOD 5.4380042e-05
8,329 SMARTFEAT: Efficient Feature Construction through Feature-Level Foundation Model Interactions 2024 CIDR 5.3520477e-05
8,744 Progressive Deep Web Crawling Through Keyword Queries For Data Enrichment 2019 SIGMOD 5.287931e-05
8,764 Exploratory Training: When Annotators Learn About Data 2023 SIGMOD 5.2815275e-05
8,862 Rapidash: Efficient Detection of Constraint Violations 2024 VLDB 5.2616231e-05
9,033 Fainder: A Fast and Accurate Index for Distribution-Aware Dataset Search 2024 VLDB 5.2322216e-05
9,320 VerifAI: Verified Generative AI 2024 CIDR 5.1941278e-05
9,394 A Data Quality Metric (DQM): How to Estimate the Number of Undetected Errors in Data Sets 2017 VLDB 5.1843659e-05
9,426 Towards Observability for Production Machine Learning Pipelines 2022 VLDB 5.1779092e-05
9,623 GIDCL: A Graph-Enhanced Interpretable Data Cleaning Framework with Large Language Models 2024 SIGMOD 5.1486163e-05
9,682 Debugging Large-Scale Data Science Pipelines using Dagger 2020 VLDB 5.1413762e-05
10,185 In-Database Data Imputation 2024 SIGMOD 5.0629036e-05
10,364 Towards Scalable Visual Data Wrangling via Direct Manipulation 2026 CIDR 4.9769913e-05
10,540 Minimum Change ≠ Best Cleaning: Parallel and Incremental Error Detection under Integrity Constraints 2026 SIGMOD 4.9769913e-05
10,814 Document-to-Database: Extraction Meets Relational Semantics 2026 VLDB 4.9769913e-05
11,181 Zorro: Quantifying Uncertainty in Models & Predictions Arising from Dirty Data 2025 SIGMOD 4.9769913e-05
11,360 UniClean: A Scalable Data Cleaning Solution for Mixed Errors based on Unified Cleaners and Optimized Cleaning Workflow 2025 VLDB 4.9769913e-05
11,417 Demonstrating Matelda for Multi-Table Error Detection 2025 VLDB 4.9769913e-05
11,737 Demystifying the QoS and QoE of Edge-hosted Video Streaming Applications in the Wild with SNESet 2023 SIGMOD 4.9769913e-05
12,036 GEDet: Detecting Erroneous Nodes with A Few Examples 2021 VLDB 4.9769913e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 13 of 13 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Previous Page 1 / 1 Next

Semantically Similar Papers