DBScholar

Back to papers

Data Cleaning: Overview and Emerging Challenges

Summary: Presents a taxonomy of data cleaning, focusing on constraint- and pattern-based detection and repair for data quality. Links qualitative cleaning to ML and statistics, addressing scalability for big data and its impact on analytics, with a statistical view on inference. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
hf54e72c502dcf46e
Venue
SIGMOD
Year
2016
Pagerank
0.00012638176
Overall Rank
989 | 93.38%
DOI
10.1145/2882903.2912574

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{chu_sigmod16,
        title = {{Data Cleaning: Overview and Emerging Challenges}},
        author = {Chu, Xu and Ilyas, Ihab F. and Krishnan, Sanjay and Wang, Jiannan},
        series = {{SIGMOD} '16},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/2882903.2912574},
        url = {https://dl.acm.org/doi/10.1145/2882903.2912574},
        year = {2016}
}

Incoming Citations (Sorted by Pagerank)

Showing 39 of 39 citing papers.

Rank Citing Paper Year Venue Pagerank
1,278 Automating Large-Scale Data Quality Verification 2018 VLDB 0.00011208469
1,669 Table-GPT: Table Fine-tuned GPT for Diverse Table Tasks 2024 SIGMOD 9.9157758e-05
2,373 SCODED: Statistical Constraint Oriented Data Error Detection 2020 SIGMOD 8.5434538e-05
3,277 Automatic Data Repair: Are We Ready to Deploy? 2024 VLDB 7.4527106e-05
3,318 Cleaning Crowdsourced Labels Using Oracles for Statistical Classification 2019 VLDB 7.4142395e-05
3,711 TensorFlow Data Validation: Data Analysis and Validation in Continuous ML Pipelines 2020 SIGMOD 7.0580105e-05
3,970 DiffPrep: Differentiable Data Preprocessing Pipeline Search for Learning over Tabular Data 2023 SIGMOD 6.8768492e-05
4,186 Data Integration and Machine Learning: A Natural Synergy 2018 SIGMOD 6.7408641e-05
4,203 PrIU: A Provenance-Based Approach for Incrementally Updating Regression Models 2020 SIGMOD 6.7255278e-05
5,406 Efficient Knowledge Graph Accuracy Evaluation 2019 VLDB 6.1326233e-05
6,062 Your notebook is not crumby enough, REPLace it 2020 CIDR 5.8829004e-05
6,196 Causal Data Integration 2023 VLDB 5.8366172e-05
6,438 CtxPipe: Context-aware Data Preparation Pipeline Construction for Machine Learning 2024 SIGMOD 5.7678369e-05
6,564 Finding Label and Model Errors in Perception Data With Learned Observation Assertions 2022 SIGMOD 5.7283392e-05
7,076 How do Categorical Duplicates Affect ML? A New Benchmark and Empirical Analyses 2024 VLDB 5.5909675e-05
7,496 Fast Detection of Denial Constraint Violations 2022 VLDB 5.4968024e-05
7,527 PIClean: A Probabilistic and Interactive Data Cleaning System 2019 SIGMOD 5.4868307e-05
7,723 ReStore - Neural Data Completion for Relational Databases 2021 SIGMOD 5.4534466e-05
7,884 Learning Over Dirty Data Without Cleaning 2020 SIGMOD 5.4169982e-05
8,192 Fast and Reliable Missing Data Contingency Analysis with Predicate-Constraints 2020 SIGMOD 5.3646457e-05
8,301 The Computation of Optimal Subset Repairs 2020 VLDB 5.3433509e-05
9,420 A Data Quality Metric (DQM): How to Estimate the Number of Undetected Errors in Data Sets 2017 VLDB 5.1672232e-05
9,758 DataVinci: Learning Syntactic and Semantic String Repairs 2025 SIGMOD 5.115551e-05
10,218 In-Database Data Imputation 2024 SIGMOD 5.0461625e-05
10,224 Reptile: Aggregation-level Explanations for Hierarchical Data 2022 SIGMOD 5.0460607e-05
10,385 Budgeted Interactive Property Graph Repair with GNN 2027 SIGMOD 4.9605343e-05
10,397 FlowPipe: LLM-Enhanced Conditional Generative Flow Networks for Data Preparation Pipeline Construction 2027 SIGMOD 4.9605343e-05
10,576 Shape-Agnostic Table Overlap Discovery: A Maximum Common Subhypergraph Approach 2026 SIGMOD 4.9605343e-05
10,592 Understanding the Impact of Data Noise in Federated Learning: [Experiments & Analysis] 2026 SIGMOD 4.9605343e-05
10,679 WaveStitch: Flexible and Fast Conditional Time Series Generation With Diffusion Models 2026 SIGMOD 4.9605343e-05
10,778 Repairing Property Graphs under PG-Constraints 2026 VLDB 4.9605343e-05
10,875 Document-to-Database: Extraction Meets Relational Semantics 2026 VLDB 4.9605343e-05
10,923 Auto-Fill: Learning to Predict Missing Values Accurately with Specialist Language Models 2026 VLDB 4.9605343e-05
11,040 PGShield: Maintaining Path Constraints in Property Graphs 2026 VLDB 4.9605343e-05
11,627 Efficient and Reliable Estimation of Knowledge Graph Accuracy 2024 VLDB 4.9605343e-05
11,751 LinCQA: Faster Consistent Query Answering with Linear Time Guarantees 2023 SIGMOD 4.9605343e-05
11,781 Demystifying the QoS and QoE of Edge-hosted Video Streaming Applications in the Wild with SNESet 2023 SIGMOD 4.9605343e-05
12,086 LOCATER: Cleaning WiFi Connectivity Datasets for Semantic Localization 2021 VLDB 4.9605343e-05
12,226 IHCS: An Integrated Hybrid Cleaning System 2019 VLDB 4.9605343e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 45 of 45 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
95 Potter's Wheel: An Interactive Data Cleaning System 2001 VLDB 0.00034319763
190 A Cost-Based Model and Effective Heuristic for Repairing Constraints by Value Modification 2005 SIGMOD 0.00025812169
191 Scorpion: Explaining Away Outliers in Aggregate Queries 2013 VLDB 0.0002578784
199 CrowdER: Crowdsourcing Entity Resolution 2012 VLDB 0.0002551523
260 Answering Queries using Humans, Algorithms and Databases 2011 CIDR 0.00022866018
308 Eliminating Fuzzy Duplicates in Data Warehouses 2002 VLDB 0.0002143466
343 Model-Driven Data Acquisition in Sensor Networks 2004 VLDB 0.00020486383
348 Discovering Denial Constraints 2013 VLDB 0.00020216677
434 Corleone: Hands-Off Crowdsourcing for Entity Matching 2014 SIGMOD 0.00018323777
516 Data Curation at Scale: The Data Tamer System 2013 CIDR 0.00016963937
527 Improving Data Quality: Consistency and Accuracy 2007 VLDB 0.00016859013
544 ERACER: A Database Approach for Statistical Inference and Data Cleaning 2010 SIGMOD 0.00016584014
652 Don’t be SCAREd: Use SCalable Automatic REpairing with Maximal Likelihood and Bounded Changes 2013 SIGMOD 0.00015117165
695 NADEEF: A Commodity Data Cleaning System 2013 SIGMOD 0.00014679058
717 Guided Data Repair 2011 VLDB 0.00014531658
769 The LLUNATIC Data-Cleaning Framework 2013 VLDB 0.00014091996
873 Leveraging Transitive Relations for Crowdsourced Joins 2013 SIGMOD 0.00013306946
932 Question Selection for Crowd Entity Resolution 2013 VLDB 0.00012981731
988 Towards Certain Fixes with Editing Rules and Master Data 2010 VLDB 0.00012643318
991 CrowdScreen: Algorithms for Filtering Data with Humans 2012 SIGMOD 0.00012632003
1,033 On Generating Near-Optimal Tableaux for Conditional Functional Dependencies 2008 VLDB 0.00012373297
1,099 KATARA: A Data Cleaning System Powered by Knowledge Bases and Crowdsourcing 2015 SIGMOD 0.00012008783
1,354 Sampling the Repairs of Functional Dependency Violations under Hard Constraints 2010 VLDB 0.00010912271
1,363 Adaptive Cleaning for RFID Data Streams 2006 VLDB 0.00010882694
1,510 Data Quality and Data Cleaning: An Overview 2003 SIGMOD 0.0001041104
1,721 A Sample-and-Clean Framework for Fast and Accurate Query Processing on Dirty Data 2014 SIGMOD 9.7821782e-05
2,068 Dedoop: Efficient Deduplication with Hadoop 2012 VLDB 9.0703184e-05
2,364 Online Outlier Detection in Sensor Data Using Non-Parametric Models 2006 VLDB 8.5549846e-05
2,429 BigDansing: A System for Big Data Cleansing 2015 SIGMOD 8.4657925e-05
2,459 Tracing Data Errors with View-Conditioned Causality 2011 SIGMOD 8.4137923e-05
2,492 Query-Oriented Data Cleaning with Oracles 2015 SIGMOD 8.3722864e-05
2,641 Progressive Approach to Relational Entity Resolution 2014 VLDB 8.1723025e-05
2,647 Scaling Up Crowd-Sourcing to Very Large Datasets: A Case for Active Learning 2015 VLDB 8.1565673e-05
2,650 CrowdFill: Collecting Structured Data from the Crowd 2014 SIGMOD 8.1519618e-05
2,785 Interaction between Record Matching and Data Repairing 2011 SIGMOD 7.9995952e-05
2,958 Towards Dependable Data Repairing with Fixing Rules 2014 SIGMOD 7.7991971e-05
3,437 Modeling and Querying Possible Repairs in Duplicate Detection 2009 VLDB 7.282809e-05
3,950 Continuous Outlier Detection in Data Streams: An Extensible Framework and State-Of-The-Art Algorithms 2013 SIGMOD 6.888581e-05
4,029 CLAMShell: Speeding up Crowds for Low-latency Data Labeling 2016 VLDB 6.8285702e-05
5,022 Descriptive and Prescriptive Data Cleaning 2014 SIGMOD 6.2989483e-05
5,206 QuERy: A Framework for Integrating Entity Resolution with Query Processing 2016 VLDB 6.2160113e-05
6,881 Estimating the Impact of Unknown Unknowns on Aggregate Query Results 2016 SIGMOD 5.6415853e-05
8,246 When Speed Has a Price: Fast Information Extraction Using Approximate Algorithms 2013 VLDB 5.3551656e-05
8,803 Wisteria: Nurturing Scalable Data Cleaning Infrastructure 2015 VLDB 5.2598307e-05
8,894 Stale View Cleaning: Getting Fresh Answers from Stale Materialized Views 2015 VLDB 5.2415191e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 10,606 Minimum Change ≠ Best Cleaning: Parallel and Incremental Error Detection under Integrity Constraints 2026 SIGMOD
2 7,884 Learning Over Dirty Data Without Cleaning 2020 SIGMOD
3 3,277 Automatic Data Repair: Are We Ready to Deploy? 2024 VLDB
4 1,906 Statistical Distortion: Consequences of Data Cleaning 2012 VLDB
5 11,713 Generalizable Data Cleaning of Tabular Data in Latent Space 2024 VLDB
6 5,022 Descriptive and Prescriptive Data Cleaning 2014 SIGMOD
7 1,306 Detecting Data Errors: Where are we and what needs to be done? 2016 VLDB
8 1,510 Data Quality and Data Cleaning: An Overview 2003 SIGMOD
9 13,794 Data Cleaning in the Era of Data Science: Challenges and Opportunities 2021 CIDR
10 6,327 Qualitative Data Cleaning 2016 VLDB