DBScholar

Back to papers

Detecting Data Errors: Where are we and what needs to be done?

Summary: Empirical study: data-cleaning tools miss large portions of real-world errors and have robustness gaps. Proposes multi-tool workflow to boost coverage with less verification; notes domain-specific tools and enrichment, but some errors remain undetectable. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
hf589acc29fcb027c
Venue
VLDB
Year
2016
Pagerank
0.00011076619
Overall Rank
1,306 | 91.25%
DOI
10.14778/2994509.2994518
PDF
Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{abedjan_vldb16,
        title = {{Detecting Data Errors: Where are we and what needs to be done?}},
        author = {Abedjan, Ziawasch and Chu, Xu and Deng, Dong and Fernandez, Raul Castro and Ilyas, Ihab F. and Ouzzani, Mourad and Papotti, Paolo and Stonebraker, Michael and Tang, Nan},
        journal = {PVLDB},
        series = {{VLDB} '16},
        volume = {9},
        number = {12},
        pages = {993--1004},
        doi = {10.14778/2994509.2994518},
        url = {https://doi.org/10.14778/2994509.2994518},
        year = {2016}
}

Incoming Citations (Sorted by Pagerank)

Showing 50 of 51 citing papers.

Rank Citing Paper Year Venue Pagerank
100 HoloClean: Holistic Data Repairs with Probabilistic Inference 2017 VLDB 0.00033951027
323 Can Foundation Models Wrangle Your Data? 2023 VLDB 0.00021022156
853 HoloDetect: Few-Shot Learning for Error Detection 2019 SIGMOD 0.00013437314
972 The Data Civilizer System 2017 CIDR 0.00012742827
1,347 Baran: Effective Error Correction via a Unified Context Representation and Transfer Learning 2020 VLDB 0.00010947547
1,348 Creating Embeddings of Heterogeneous Relational Datasets for Data Integration Tasks 2020 SIGMOD 0.00010943046
1,489 Synthesizing Entity Matching Rules by Examples 2018 VLDB 0.00010480559
1,731 Raha: A Configuration-Free Error Detection System 2019 SIGMOD 9.7585913e-05
1,993 RPT: Relational Pre-trained Transformer Is Almost All You Need towards Democratizing Data Preparation 2021 VLDB 9.2224853e-05
2,373 SCODED: Statistical Constraint Oriented Data Error Detection 2020 SIGMOD 8.5434538e-05
2,473 Complaint-driven Training Data Debugging for Query 2.0 2020 SIGMOD 8.3984284e-05
2,645 Auto-Suggest: Learning-to-Recommend Data Preparation Steps Using Data Science Notebooks 2020 SIGMOD 8.1641056e-05
2,752 Uni-Detect: A Unified Approach to Automated Error Detection in Tables 2019 SIGMOD 8.0387193e-05
2,960 Auto-Detect: Data-Driven Error Detection in Tables 2018 SIGMOD 7.7967245e-05
3,277 Automatic Data Repair: Are We Ready to Deploy? 2024 VLDB 7.4527106e-05
3,432 UGuide – User-Guided Discovery of FD-Detectable Errors 2017 SIGMOD 7.288198e-05
3,970 DiffPrep: Differentiable Data Preprocessing Pipeline Search for Learning over Tabular Data 2023 SIGMOD 6.8768492e-05
4,444 Auto-Transform: Learning-to-Transform by Patterns 2020 VLDB 6.5812416e-05
4,538 Pattern Functional Dependencies for Data Cleaning 2020 VLDB 6.5398994e-05
4,852 QFix: Diagnosing Errors through Query Histories 2017 SIGMOD 6.3680596e-05
4,978 Adaptive Data Augmentation for Supervised Learning over Missing Data 2021 VLDB 6.3182056e-05
5,383 SchemaPile: A Large Collection of Relational Database Schemas 2024 SIGMOD 6.1379374e-05
5,501 Semi-Supervised Data Cleaning with Raha and Baran 2021 CIDR 6.0905697e-05
5,658 Self-supervised and Interpretable Data Cleaning with Sequence Generative Adversarial Networks 2023 VLDB 6.0309825e-05
5,879 Properties of Inconsistency Measures for Databases 2021 SIGMOD 5.9438507e-05
6,062 Your notebook is not crumby enough, REPLace it 2020 CIDR 5.8829004e-05
6,438 CtxPipe: Context-aware Data Preparation Pipeline Construction for Machine Learning 2024 SIGMOD 5.7678369e-05
7,486 Time Series Data Validity 2023 SIGMOD 5.499587e-05
7,527 PIClean: A Probabilistic and Interactive Data Cleaning System 2019 SIGMOD 5.4868307e-05
7,606 Data Imputation with Limited Data Redundancy Using Data Lakes 2025 VLDB 5.4698748e-05
7,870 CoClean: Collaborative Data Cleaning 2020 SIGMOD 5.4200227e-05
8,327 SMARTFEAT: Efficient Feature Construction through Feature-Level Foundation Model Interactions 2024 CIDR 5.3381899e-05
8,763 Progressive Deep Web Crawling Through Keyword Queries For Data Enrichment 2019 SIGMOD 5.2705326e-05
8,784 Exploratory Training: When Annotators Learn About Data 2023 SIGMOD 5.2640635e-05
8,881 Rapidash: Efficient Detection of Constraint Violations 2024 VLDB 5.2442249e-05
9,054 Fainder: A Fast and Accurate Index for Distribution-Aware Dataset Search 2024 VLDB 5.2149206e-05
9,345 VerifAI: Verified Generative AI 2024 CIDR 5.1769528e-05
9,420 A Data Quality Metric (DQM): How to Estimate the Number of Undetected Errors in Data Sets 2017 VLDB 5.1672232e-05
9,454 Towards Observability for Production Machine Learning Pipelines 2022 VLDB 5.1607878e-05
9,634 GIDCL: A Graph-Enhanced Interpretable Data Cleaning Framework with Large Language Models 2024 SIGMOD 5.1354312e-05
9,711 Debugging Large-Scale Data Science Pipelines using Dagger 2020 VLDB 5.1244582e-05
10,218 In-Database Data Imputation 2024 SIGMOD 5.0461625e-05
10,397 FlowPipe: LLM-Enhanced Conditional Generative Flow Networks for Data Preparation Pipeline Construction 2027 SIGMOD 4.9605343e-05
10,431 Towards Scalable Visual Data Wrangling via Direct Manipulation 2026 CIDR 4.9605343e-05
10,606 Minimum Change ≠ Best Cleaning: Parallel and Incremental Error Detection under Integrity Constraints 2026 SIGMOD 4.9605343e-05
10,875 Document-to-Database: Extraction Meets Relational Semantics 2026 VLDB 4.9605343e-05
11,240 Zorro: Quantifying Uncertainty in Models & Predictions Arising from Dirty Data 2025 SIGMOD 4.9605343e-05
11,413 UniClean: A Scalable Data Cleaning Solution for Mixed Errors based on Unified Cleaners and Optimized Cleaning Workflow 2025 VLDB 4.9605343e-05
11,470 Demonstrating Matelda for Multi-Table Error Detection 2025 VLDB 4.9605343e-05
11,781 Demystifying the QoS and QoE of Edge-hosted Video Streaming Applications in the Wild with SNESet 2023 SIGMOD 4.9605343e-05
Previous Page 1 / 2 Next

Outgoing Citations (Sorted by Pagerank)

Showing 13 of 13 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Previous Page 1 / 1 Next

Semantically Similar Papers