DBScholar

Back to papers

Data Cleaning: Overview and Emerging Challenges

Summary: Presents a taxonomy of data cleaning, focusing on constraint- and pattern-based detection and repair for data quality. Links qualitative cleaning to ML and statistics, addressing scalability for big data and its impact on analytics, with a statistical view on inference. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
hf54e72c502dcf46e
Venue
SIGMOD
Year
2016
Pagerank
0.00012329478
Overall Rank
1,044 | 92.99%
DOI
10.1145/2882903.2912574

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{chu_sigmod16,
        title = {{Data Cleaning: Overview and Emerging Challenges}},
        author = {Chu, Xu and Ilyas, Ihab F. and Krishnan, Sanjay and Wang, Jiannan},
        series = {{SIGMOD} '16},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/2882903.2912574},
        url = {https://dl.acm.org/doi/10.1145/2882903.2912574},
        year = {2016}
}

Incoming Citations (Sorted by Pagerank)

Showing 37 of 37 citing papers.

Rank Citing Paper Year Venue Pagerank
1,308 Automating Large-Scale Data Quality Verification 2018 VLDB 0.00011073863
1,977 Table-GPT: Table Fine-tuned GPT for Diverse Table Tasks 2024 SIGMOD 9.2760522e-05
2,372 SCODED: Statistical Constraint Oriented Data Error Detection 2020 SIGMOD 8.5575299e-05
3,264 Automatic Data Repair: Are We Ready to Deploy? 2024 VLDB 7.4774357e-05
3,308 Cleaning Crowdsourced Labels Using Oracles for Statistical Classification 2019 VLDB 7.4379101e-05
3,706 TensorFlow Data Validation: Data Analysis and Validation in Continuous ML Pipelines 2020 SIGMOD 7.0796066e-05
4,171 Data Integration and Machine Learning: A Natural Synergy 2018 SIGMOD 6.7576159e-05
4,197 PrIU: A Provenance-Based Approach for Incrementally Updating Regression Models 2020 SIGMOD 6.7390419e-05
4,525 DiffPrep: Differentiable Data Preprocessing Pipeline Search for Learning over Tabular Data 2023 SIGMOD 6.559044e-05
5,385 Efficient Knowledge Graph Accuracy Evaluation 2019 VLDB 6.1529688e-05
6,048 Your notebook is not crumby enough, REPLace it 2020 CIDR 5.9024167e-05
6,186 Causal Data Integration 2023 VLDB 5.8559807e-05
6,554 Finding Label and Model Errors in Perception Data With Learned Observation Assertions 2022 SIGMOD 5.7473435e-05
6,924 CtxPipe: Context-aware Data Preparation Pipeline Construction for Machine Learning 2024 SIGMOD 5.6405901e-05
7,070 How do Categorical Duplicates Affect ML? A New Benchmark and Empirical Analyses 2024 VLDB 5.6056639e-05
7,476 Fast Detection of Denial Constraint Violations 2022 VLDB 5.5150385e-05
7,538 PIClean: A Probabilistic and Interactive Data Cleaning System 2019 SIGMOD 5.4981956e-05
7,710 ReStore - Neural Data Completion for Relational Databases 2021 SIGMOD 5.471539e-05
7,880 Learning Over Dirty Data Without Cleaning 2020 SIGMOD 5.4330096e-05
8,172 Fast and Reliable Missing Data Contingency Analysis with Predicate-Constraints 2020 SIGMOD 5.3824434e-05
8,286 The Computation of Optimal Subset Repairs 2020 VLDB 5.361078e-05
9,394 A Data Quality Metric (DQM): How to Estimate the Number of Undetected Errors in Data Sets 2017 VLDB 5.1843659e-05
9,727 DataVinci: Learning Syntactic and Semantic String Repairs 2025 SIGMOD 5.1325223e-05
10,185 In-Database Data Imputation 2024 SIGMOD 5.0629036e-05
10,191 Reptile: Aggregation-level Explanations for Hierarchical Data 2022 SIGMOD 5.0628015e-05
10,510 Shape-Agnostic Table Overlap Discovery: A Maximum Common Subhypergraph Approach 2026 SIGMOD 4.9769913e-05
10,526 Understanding the Impact of Data Noise in Federated Learning: [Experiments & Analysis] 2026 SIGMOD 4.9769913e-05
10,618 WaveStitch: Flexible and Fast Conditional Time Series Generation With Diffusion Models 2026 SIGMOD 4.9769913e-05
10,717 Repairing Property Graphs under PG-Constraints 2026 VLDB 4.9769913e-05
10,814 Document-to-Database: Extraction Meets Relational Semantics 2026 VLDB 4.9769913e-05
10,862 Auto-Fill: Learning to Predict Missing Values Accurately with Specialist Language Models 2026 VLDB 4.9769913e-05
10,979 PGShield: Maintaining Path Constraints in Property Graphs 2026 VLDB 4.9769913e-05
11,578 Efficient and Reliable Estimation of Knowledge Graph Accuracy 2024 VLDB 4.9769913e-05
11,705 LinCQA: Faster Consistent Query Answering with Linear Time Guarantees 2023 SIGMOD 4.9769913e-05
11,737 Demystifying the QoS and QoE of Edge-hosted Video Streaming Applications in the Wild with SNESet 2023 SIGMOD 4.9769913e-05
12,042 LOCATER: Cleaning WiFi Connectivity Datasets for Semantic Localization 2021 VLDB 4.9769913e-05
12,183 IHCS: An Integrated Hybrid Cleaning System 2019 VLDB 4.9769913e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 45 of 45 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
95 Potter's Wheel: An Interactive Data Cleaning System 2001 VLDB 0.00034367518
188 A Cost-Based Model and Effective Heuristic for Repairing Constraints by Value Modification 2005 SIGMOD 0.00025861123
190 Scorpion: Explaining Away Outliers in Aggregate Queries 2013 VLDB 0.0002582857
198 CrowdER: Crowdsourcing Entity Resolution 2012 VLDB 0.00025546182
259 Answering Queries using Humans, Algorithms and Databases 2011 CIDR 0.00022916014
307 Eliminating Fuzzy Duplicates in Data Warehouses 2002 VLDB 0.00021489374
343 Model-Driven Data Acquisition in Sensor Networks 2004 VLDB 0.00020510274
350 Discovering Denial Constraints 2013 VLDB 0.00020244085
433 Corleone: Hands-Off Crowdsourcing for Entity Matching 2014 SIGMOD 0.00018324965
514 Data Curation at Scale: The Data Tamer System 2013 CIDR 0.00016999652
526 Improving Data Quality: Consistency and Accuracy 2007 VLDB 0.00016879
548 ERACER: A Database Approach for Statistical Inference and Data Cleaning 2010 SIGMOD 0.00016572863
652 Don’t be SCAREd: Use SCalable Automatic REpairing with Maximal Likelihood and Bounded Changes 2013 SIGMOD 0.00015114401
697 NADEEF: A Commodity Data Cleaning System 2013 SIGMOD 0.00014687805
716 Guided Data Repair 2011 VLDB 0.00014546968
767 The LLUNATIC Data-Cleaning Framework 2013 VLDB 0.00014108234
871 Leveraging Transitive Relations for Crowdsourced Joins 2013 SIGMOD 0.00013338722
934 Question Selection for Crowd Entity Resolution 2013 VLDB 0.00012998402
987 CrowdScreen: Algorithms for Filtering Data with Humans 2012 SIGMOD 0.00012655094
989 Towards Certain Fixes with Editing Rules and Master Data 2010 VLDB 0.00012647631
1,031 On Generating Near-Optimal Tableaux for Conditional Functional Dependencies 2008 VLDB 0.00012399252
1,098 KATARA: A Data Cleaning System Powered by Knowledge Bases and Crowdsourcing 2015 SIGMOD 0.00012031983
1,348 Sampling the Repairs of Functional Dependency Violations under Hard Constraints 2010 VLDB 0.00010942213
1,361 Adaptive Cleaning for RFID Data Streams 2006 VLDB 0.00010912941
1,510 Data Quality and Data Cleaning: An Overview 2003 SIGMOD 0.00010435139
1,722 A Sample-and-Clean Framework for Fast and Accurate Query Processing on Dirty Data 2014 SIGMOD 9.7921604e-05
2,072 Dedoop: Efficient Deduplication with Hadoop 2012 VLDB 9.0834235e-05
2,360 Online Outlier Detection in Sensor Data Using Non-Parametric Models 2006 VLDB 8.5774153e-05
2,424 BigDansing: A System for Big Data Cleansing 2015 SIGMOD 8.483813e-05
2,458 Tracing Data Errors with View-Conditioned Causality 2011 SIGMOD 8.4334752e-05
2,505 Query-Oriented Data Cleaning with Oracles 2015 SIGMOD 8.3743595e-05
2,643 Scaling Up Crowd-Sourcing to Very Large Datasets: A Case for Active Learning 2015 VLDB 8.1741373e-05
2,645 Progressive Approach to Relational Entity Resolution 2014 VLDB 8.173459e-05
2,653 CrowdFill: Collecting Structured Data from the Crowd 2014 SIGMOD 8.1693619e-05
2,784 Interaction between Record Matching and Data Repairing 2011 SIGMOD 8.0147123e-05
2,967 Towards Dependable Data Repairing with Fixing Rules 2014 SIGMOD 7.8016942e-05
3,426 Modeling and Querying Possible Repairs in Duplicate Detection 2009 VLDB 7.3053186e-05
3,949 Continuous Outlier Detection in Data Streams: An Extensible Framework and State-Of-The-Art Algorithms 2013 SIGMOD 6.9051268e-05
4,025 CLAMShell: Speeding up Crowds for Low-latency Data Labeling 2016 VLDB 6.8439934e-05
5,000 Descriptive and Prescriptive Data Cleaning 2014 SIGMOD 6.3194405e-05
5,199 QuERy: A Framework for Integrating Entity Resolution with Query Processing 2016 VLDB 6.2309669e-05
6,885 Estimating the Impact of Unknown Unknowns on Aggregate Query Results 2016 SIGMOD 5.6546466e-05
8,250 When Speed Has a Price: Fast Information Extraction Using Approximate Algorithms 2013 VLDB 5.3672766e-05
8,785 Wisteria: Nurturing Scalable Data Cleaning Infrastructure 2015 VLDB 5.2767488e-05
8,876 Stale View Cleaning: Getting Fresh Answers from Stale Materialized Views 2015 VLDB 5.2587627e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 10,540 Minimum Change ≠ Best Cleaning: Parallel and Incremental Error Detection under Integrity Constraints 2026 SIGMOD
2 7,880 Learning Over Dirty Data Without Cleaning 2020 SIGMOD
3 3,264 Automatic Data Repair: Are We Ready to Deploy? 2024 VLDB
4 1,915 Statistical Distortion: Consequences of Data Cleaning 2012 VLDB
5 11,667 Generalizable Data Cleaning of Tabular Data in Latent Space 2024 VLDB
6 5,000 Descriptive and Prescriptive Data Cleaning 2014 SIGMOD
7 1,344 Detecting Data Errors: Where are we and what needs to be done? 2016 VLDB
8 1,510 Data Quality and Data Cleaning: An Overview 2003 SIGMOD
9 13,754 Data Cleaning in the Era of Data Science: Challenges and Opportunities 2021 CIDR
10 6,384 Qualitative Data Cleaning 2016 VLDB