DBScholar

Back to papers

Data Cleaning: Overview and Emerging Challenges

Summary: Presents a taxonomy of data cleaning, focusing on constraint- and pattern-based detection and repair for data quality. Links qualitative cleaning to ML and statistics, addressing scalability for big data and its impact on analytics, with a statistical view on inference. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
5279
Venue
SIGMOD
Year
2016
Pagerank
0.00011152602
Overall Rank
1,323 | 90.93%
DOI
10.1145/2882903.2912574

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{chu_sigmod16,
        title = {{Data Cleaning: Overview and Emerging Challenges}},
        author = {Chu, Xu and Ilyas, Ihab F. and Krishnan, Sanjay and Wang, Jiannan},
        series = {{SIGMOD} '16},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/2882903.2912574},
        url = {https://dl.acm.org/doi/10.1145/2882903.2912574},
        year = {2016}
}

Incoming Citations (Sorted by Pagerank)

Showing 34 of 34 citing papers.

Rank Citing Paper Year Venue Pagerank
1,350 Automating Large-Scale Data Quality Verification 2018 VLDB 0.00011065626
2,099 Table-GPT: Table Fine-tuned GPT for Diverse Table Tasks 2024 SIGMOD 9.1682353e-05
3,004 SCODED: Statistical Constraint Oriented Data Error Detection 2020 SIGMOD 7.8608629e-05
3,281 Cleaning Crowdsourced Labels Using Oracles for Statistical Classification 2019 VLDB 7.5706653e-05
3,580 Automatic Data Repair: Are We Ready to Deploy? 2024 VLDB 7.2888516e-05
3,630 TensorFlow Data Validation: Data Analysis and Validation in Continuous ML Pipelines 2020 SIGMOD 7.2387749e-05
4,100 Data Integration and Machine Learning: A Natural Synergy 2018 SIGMOD 6.9016092e-05
4,130 PrIU: A Provenance-Based Approach for Incrementally Updating Regression Models 2020 SIGMOD 6.8839621e-05
5,291 DiffPrep: Differentiable Data Preprocessing Pipeline Search for Learning over Tabular Data 2023 SIGMOD 6.2801343e-05
5,931 Your notebook is not crumby enough, REPLace it 2020 CIDR 6.0369708e-05
6,054 Causal Data Integration 2023 VLDB 5.9932261e-05
6,431 Finding Label and Model Errors in Perception Data With Learned Observation Assertions 2022 SIGMOD 5.8802622e-05
6,581 Efficient Knowledge Graph Accuracy Evaluation 2019 VLDB 5.8364579e-05
6,928 How do Categorical Duplicates Affect ML? A New Benchmark and Empirical Analyses 2024 VLDB 5.7370426e-05
7,387 PIClean: A Probabilistic and Interactive Data Cleaning System 2019 SIGMOD 5.6270554e-05
7,396 Fast Detection of Denial Constraint Violations 2022 VLDB 5.6257228e-05
7,556 ReStore - Neural Data Completion for Relational Databases 2021 SIGMOD 5.5997742e-05
7,880 Learning Over Dirty Data Without Cleaning 2020 SIGMOD 5.5244204e-05
8,002 Fast and Reliable Missing Data Contingency Analysis with Predicate-Constraints 2020 SIGMOD 5.5085906e-05
8,103 The Computation of Optimal Subset Repairs 2020 VLDB 5.4867244e-05
8,914 CtxPipe: Context-aware Data Preparation Pipeline Construction for Machine Learning 2024 SIGMOD 5.3483178e-05
9,206 A Data Quality Metric (DQM): How to Estimate the Number of Undetected Errors in Data Sets 2017 VLDB 5.3058708e-05
9,539 DataVinci: Learning Syntactic and Semantic String Repairs 2025 SIGMOD 5.2528121e-05
9,993 In-Database Data Imputation 2024 SIGMOD 5.1815618e-05
10,001 Reptile: Aggregation-level Explanations for Hierarchical Data 2022 SIGMOD 5.1814573e-05
10,287 Shape-Agnostic Table Overlap Discovery: A Maximum Common Subhypergraph Approach 2026 SIGMOD 5.093636e-05
10,303 Understanding the Impact of Data Noise in Federated Learning: [Experiments & Analysis] 2026 SIGMOD 5.093636e-05
10,416 WaveStitch: Flexible and Fast Conditional Time Series Generation With Diffusion Models 2026 SIGMOD 5.093636e-05
10,523 Repairing Property Graphs under PG-Constraints 2026 VLDB 5.093636e-05
11,239 Efficient and Reliable Estimation of Knowledge Graph Accuracy 2024 VLDB 5.093636e-05
11,384 LinCQA: Faster Consistent Query Answering with Linear Time Guarantees 2023 SIGMOD 5.093636e-05
11,417 Demystifying the QoS and QoE of Edge-hosted Video Streaming Applications in the Wild with SNESet 2023 SIGMOD 5.093636e-05
11,733 LOCATER: Cleaning WiFi Connectivity Datasets for Semantic Localization 2021 VLDB 5.093636e-05
11,877 IHCS: An Integrated Hybrid Cleaning System 2019 VLDB 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 45 of 45 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
94 Potter's Wheel: An Interactive Data Cleaning System 2001 VLDB 0.00034616103
185 A Cost-Based Model and Effective Heuristic for Repairing Constraints by Value Modification 2005 SIGMOD 0.00026231189
191 Scorpion: Explaining Away Outliers in Aggregate Queries 2013 VLDB 0.00026096009
196 CrowdER: Crowdsourcing Entity Resolution 2012 VLDB 0.00025780596
250 Answering Queries using Humans, Algorithms and Databases 2011 CIDR 0.00023261164
306 Eliminating Fuzzy Duplicates in Data Warehouses 2002 VLDB 0.00021839661
337 Model-Driven Data Acquisition in Sensor Networks 2004 VLDB 0.00020783399
376 Discovering Denial Constraints 2013 VLDB 0.00019677674
439 Corleone: Hands-Off Crowdsourcing for Entity Matching 2014 SIGMOD 0.00018464913
516 Data Curation at Scale: The Data Tamer System 2013 CIDR 0.00017171198
533 Improving Data Quality: Consistency and Accuracy 2007 VLDB 0.0001705859
549 ERACER: A Database Approach for Statistical Inference and Data Cleaning 2010 SIGMOD 0.00016692839
661 Don’t be SCAREd: Use SCalable Automatic REpairing with Maximal Likelihood and Bounded Changes 2013 SIGMOD 0.0001519162
714 Guided Data Repair 2011 VLDB 0.00014662041
725 NADEEF: A Commodity Data Cleaning System 2013 SIGMOD 0.00014617251
800 The LLUNATIC Data-Cleaning Framework 2013 VLDB 0.00013911223
852 Leveraging Transitive Relations for Crowdsourced Joins 2013 SIGMOD 0.00013604253
933 Question Selection for Crowd Entity Resolution 2013 VLDB 0.00013111293
997 CrowdScreen: Algorithms for Filtering Data with Humans 2012 SIGMOD 0.00012755983
998 Towards Certain Fixes with Editing Rules and Master Data 2010 VLDB 0.0001275238
1,033 On Generating Near-Optimal Tableaux for Conditional Functional Dependencies 2008 VLDB 0.00012529852
1,101 KATARA: A Data Cleaning System Powered by Knowledge Bases and Crowdsourcing 2015 SIGMOD 0.00012168934
1,331 Adaptive Cleaning for RFID Data Streams 2006 VLDB 0.00011130651
1,332 Sampling the Repairs of Functional Dependency Violations under Hard Constraints 2010 VLDB 0.00011129529
1,484 Data Quality and Data Cleaning: An Overview 2003 SIGMOD 0.00010631363
1,736 A Sample-and-Clean Framework for Fast and Accurate Query Processing on Dirty Data 2014 SIGMOD 9.8984415e-05
2,055 Dedoop: Efficient Deduplication with Hadoop 2012 VLDB 9.2512023e-05
2,340 Online Outlier Detection in Sensor Data Using Non-Parametric Models 2006 VLDB 8.7246796e-05
2,398 BigDansing: A System for Big Data Cleansing 2015 SIGMOD 8.631172e-05
2,432 Tracing Data Errors with View-Conditioned Causality 2011 SIGMOD 8.5870067e-05
2,570 Query-Oriented Data Cleaning with Oracles 2015 SIGMOD 8.4061164e-05
2,626 Scaling Up Crowd-Sourcing to Very Large Datasets: A Case for Active Learning 2015 VLDB 8.3291889e-05
2,636 CrowdFill: Collecting Structured Data from the Crowd 2014 SIGMOD 8.31868e-05
2,711 Progressive Approach to Relational Entity Resolution 2014 VLDB 8.2178865e-05
2,782 Interaction between Record Matching and Data Repairing 2011 SIGMOD 8.1280264e-05
2,981 Towards Dependable Data Repairing with Fixing Rules 2014 SIGMOD 7.8960114e-05
3,371 Modeling and Querying Possible Repairs in Duplicate Detection 2009 VLDB 7.4697134e-05
3,958 Continuous Outlier Detection in Data Streams: An Extensible Framework and State-Of-The-Art Algorithms 2013 SIGMOD 6.9909714e-05
3,971 CLAMShell: Speeding up Crowds for Low-latency Data Labeling 2016 VLDB 6.9835263e-05
4,890 Descriptive and Prescriptive Data Cleaning 2014 SIGMOD 6.4590072e-05
5,204 QuERy: A Framework for Integrating Entity Resolution with Query Processing 2016 VLDB 6.3187983e-05
6,819 Estimating the Impact of Unknown Unknowns on Aggregate Query Results 2016 SIGMOD 5.7635226e-05
8,195 When Speed Has a Price: Fast Information Extraction Using Approximate Algorithms 2013 VLDB 5.4694257e-05
8,620 Wisteria: Nurturing Scalable Data Cleaning Infrastructure 2015 VLDB 5.3991092e-05
8,714 Stale View Cleaning: Getting Fresh Answers from Stale Materialized Views 2015 VLDB 5.3778009e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 10,322 Minimum Change ≠ Best Cleaning: Parallel and Incremental Error Detection under Integrity Constraints 2026 SIGMOD
2 7,880 Learning Over Dirty Data Without Cleaning 2020 SIGMOD
3 3,580 Automatic Data Repair: Are We Ready to Deploy? 2024 VLDB
4 1,914 Statistical Distortion: Consequences of Data Cleaning 2012 VLDB
5 11,343 Generalizable Data Cleaning of Tabular Data in Latent Space 2024 VLDB
6 4,890 Descriptive and Prescriptive Data Cleaning 2014 SIGMOD
7 1,351 Detecting Data Errors: Where are we and what needs to be done? 2016 VLDB
8 1,484 Data Quality and Data Cleaning: An Overview 2003 SIGMOD
9 13,435 Data Cleaning in the Era of Data Science: Challenges and Opportunities 2021 CIDR
10 6,392 Qualitative Data Cleaning 2016 VLDB