Database Paper Browser

Back to papers

Data Cleaning: Overview and Emerging Challenges

Summary: Presents a taxonomy of data cleaning, focusing on constraint- and pattern-based detection and repair for data quality. Links qualitative cleaning to ML and statistics, addressing scalability for big data and its impact on analytics, with a statistical view on inference. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
5218
Venue
SIGMOD
Year
2016
Pagerank
0.00011073148
Overall Rank
1,629 | 88.69%
DOI
10.1145/2882903.2912574

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 32 of 32 citing papers.

Rank Citing Paper Year Venue Pagerank
1,481 Automating Large-Scale Data Quality Verification 2018 VLDB 0.00011715754
2,585 Table-GPT: Table Fine-tuned GPT for Diverse Table Tasks 2024 SIGMOD 8.4909917e-05
3,303 SCODED: Statistical Constraint Oriented Data Error Detection 2020 SIGMOD 7.2438671e-05
3,397 Automatic Data Repair: Are We Ready to Deploy? 2024 VLDB 7.1386386e-05
3,495 TensorFlow Data Validation: Data Analysis and Validation in Continuous ML Pipelines 2020 SIGMOD 7.0383507e-05
3,767 Cleaning Crowdsourced Labels Using Oracles for Statistical Classification 2019 VLDB 6.7748725e-05
4,423 PrIU: A Provenance-Based Approach for Incrementally Updating Regression Models 2020 SIGMOD 6.1925724e-05
4,596 Data Integration and Machine Learning: A Natural Synergy 2018 SIGMOD 6.0540725e-05
5,439 DiffPrep: Differentiable Data Preprocessing Pipeline Search for Learning over Tabular Data 2023 SIGMOD 5.5034427e-05
6,139 Finding Label and Model Errors in Perception Data With Learned Observation Assertions 2022 SIGMOD 5.1893488e-05
6,295 Your notebook is not crumby enough, REPLace it 2020 CIDR 5.1200006e-05
6,445 Causal Data Integration 2023 VLDB 5.0539192e-05
6,552 How do Categorical Duplicates Affect ML? A New Benchmark and Empirical Analyses 2024 VLDB 5.0109216e-05
6,690 Efficient Knowledge Graph Accuracy Evaluation 2019 VLDB 4.9575975e-05
7,565 PIClean: A Probabilistic and Interactive Data Cleaning System 2019 SIGMOD 4.7048523e-05
7,634 ReStore - Neural Data Completion for Relational Databases 2021 SIGMOD 4.6866388e-05
7,666 Fast Detection of Denial Constraint Violations 2022 VLDB 4.6792751e-05
7,868 Learning Over Dirty Data Without Cleaning 2020 SIGMOD 4.6276013e-05
8,014 The Computation of Optimal Subset Repairs 2020 VLDB 4.6020746e-05
8,139 Fast and Reliable Missing Data Contingency Analysis with Predicate-Constraints 2020 SIGMOD 4.5727142e-05
8,739 CtxPipe: Context-aware Data Preparation Pipeline Construction for Machine Learning 2024 SIGMOD 4.4520434e-05
9,055 A Data Quality Metric (DQM): How to Estimate the Number of Undetected Errors in Data Sets 2017 VLDB 4.3997447e-05
9,395 DataVinci: Learning Syntactic and Semantic String Repairs 2025 SIGMOD 4.3399748e-05
9,849 Reptile: Aggregation-level Explanations for Hierarchical Data 2022 SIGMOD 4.2680295e-05
9,855 In-Database Data Imputation 2024 SIGMOD 4.2652623e-05
10,128 WaveStitch: Flexible and Fast Conditional Time Series Generation With Diffusion Models 2026 SIGMOD 4.1905499e-05
10,235 Repairing Property Graphs under PG-Constraints 2026 VLDB 4.1905499e-05
11,032 Efficient and Reliable Estimation of Knowledge Graph Accuracy 2024 VLDB 4.1905499e-05
11,181 LinCQA: Faster Consistent Query Answering with Linear Time Guarantees 2023 SIGMOD 4.1905499e-05
11,218 Demystifying the QoS and QoE of Edge-hosted Video Streaming Applications in the Wild with SNESet 2023 SIGMOD 4.1905499e-05
11,540 LOCATER: Cleaning WiFi Connectivity Datasets for Semantic Localization 2021 VLDB 4.1905499e-05
11,687 IHCS: An Integrated Hybrid Cleaning System 2019 VLDB 4.1905499e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 45 of 45 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
112 Potter's Wheel: An Interactive Data Cleaning System 2001 VLDB 0.00047010908
118 Answering Queries using Humans, Algorithms and Databases 2011 CIDR 0.00045860394
213 Scorpion: Explaining Away Outliers in Aggregate Queries 2013 VLDB 0.0003371037
265 CrowdER: Crowdsourcing Entity Resolution 2012 VLDB 0.00029904018
268 A Cost-Based Model and Effective Heuristic for Repairing Constraints by Value Modification 2005 SIGMOD 0.00029739054
279 Eliminating Fuzzy Duplicates in Data Warehouses 2002 VLDB 0.00029141798
477 Model-Driven Data Acquisition in Sensor Networks 2004 VLDB 0.00022205608
488 Data Curation at Scale: The Data Tamer System 2013 CIDR 0.00022029993
508 Data Quality and Data Cleaning: An Overview 2003 SIGMOD 0.00021473523
556 Discovering Denial Constraints 2013 VLDB 0.00020214701
621 Improving Data Quality: Consistency and Accuracy 2007 VLDB 0.00018978331
641 Corleone: Hands-Off Crowdsourcing for Entity Matching 2014 SIGMOD 0.00018759417
656 ERACER: A Database Approach for Statistical Inference and Data Cleaning 2010 SIGMOD 0.00018590675
830 Guided Data Repair 2011 VLDB 0.00016125759
863 Leveraging Transitive Relations for Crowdsourced Joins 2013 SIGMOD 0.00015793243
879 Don’t be SCAREd: Use SCalable Automatic REpairing with Maximal Likelihood and Bounded Changes 2013 SIGMOD 0.00015649604
1,012 NADEEF: A Commodity Data Cleaning System 2013 SIGMOD 0.00014638349
1,154 CrowdScreen: Algorithms for Filtering Data with Humans 2012 SIGMOD 0.00013616867
1,160 Towards Certain Fixes with Editing Rules and Master Data 2010 VLDB 0.0001358129
1,187 On Generating Near-Optimal Tableaux for Conditional Functional Dependencies 2008 VLDB 0.00013432048
1,197 The LLUNATIC Data-Cleaning Framework 2013 VLDB 0.00013373177
1,242 Question Selection for Crowd Entity Resolution 2013 VLDB 0.00013088272
1,544 KATARA: A Data Cleaning System Powered by Knowledge Bases and Crowdsourcing 2015 SIGMOD 0.00011438274
1,595 Adaptive Cleaning for RFID Data Streams 2006 VLDB 0.0001121094
1,625 Sampling the Repairs of Functional Dependency Violations under Hard Constraints 2010 VLDB 0.0001109361
2,177 A Sample-and-Clean Framework for Fast and Accurate Query Processing on Dirty Data 2014 SIGMOD 9.371335e-05
2,205 Dedoop: Efficient Deduplication with Hadoop 2012 VLDB 9.2962961e-05
2,600 Tracing Data Errors with View-Conditioned Causality 2011 SIGMOD 8.4652308e-05
2,635 Online Outlier Detection in Sensor Data Using Non-Parametric Models 2006 VLDB 8.4081184e-05
2,725 Progressive Approach to Relational Entity Resolution 2014 VLDB 8.2268045e-05
2,805 Query-Oriented Data Cleaning with Oracles 2015 SIGMOD 8.103731e-05
2,830 Interaction between Record Matching and Data Repairing 2011 SIGMOD 8.0515409e-05
3,000 BigDansing: A System for Big Data Cleansing 2015 SIGMOD 7.7447724e-05
3,020 Scaling Up Crowd-Sourcing to Very Large Datasets: A Case for Active Learning 2015 VLDB 7.6987905e-05
3,071 CrowdFill: Collecting Structured Data from the Crowd 2014 SIGMOD 7.6120337e-05
3,198 Towards Dependable Data Repairing with Fixing Rules 2014 SIGMOD 7.4029546e-05
3,366 Modeling and Querying Possible Repairs in Duplicate Detection 2009 VLDB 7.1671634e-05
3,921 Continuous Outlier Detection in Data Streams: An Extensible Framework and State-Of-The-Art Algorithms 2013 SIGMOD 6.6245531e-05
4,453 CLAMShell: Speeding up Crowds for Low-latency Data Labeling 2016 VLDB 6.1690121e-05
5,594 QuERy: A Framework for Integrating Entity Resolution with Query Processing 2016 VLDB 5.416945e-05
5,671 Descriptive and Prescriptive Data Cleaning 2014 SIGMOD 5.3797808e-05
6,943 Estimating the Impact of Unknown Unknowns on Aggregate Query Results 2016 SIGMOD 4.8876509e-05
8,153 When Speed Has a Price: Fast Information Extraction Using Approximate Algorithms 2013 VLDB 4.5710056e-05
8,590 Wisteria: Nurturing Scalable Data Cleaning Infrastructure 2015 VLDB 4.4851741e-05
8,703 Stale View Cleaning: Getting Fresh Answers from Stale Materialized Views 2015 VLDB 4.4596255e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

Overall Rank Paper Year Venue Pagerank
10,026 Minimum Change ≠ Best Cleaning: Parallel and Incremental Error Detection under Integrity Constraints 2026 SIGMOD 4.1905499e-05
7,868 Learning Over Dirty Data Without Cleaning 2020 SIGMOD 4.6276013e-05
3,397 Automatic Data Repair: Are We Ready to Deploy? 2024 VLDB 7.1386386e-05
1,975 Statistical Distortion: Consequences of Data Cleaning 2012 VLDB 9.881077e-05
11,140 Generalizable Data Cleaning of Tabular Data in Latent Space 2024 VLDB 4.1905499e-05
5,671 Descriptive and Prescriptive Data Cleaning 2014 SIGMOD 5.3797808e-05
1,403 Detecting Data Errors: Where are we and what needs to be done? 2016 VLDB 0.00012180046
508 Data Quality and Data Cleaning: An Overview 2003 SIGMOD 0.00021473523
13,245 Data Cleaning in the Era of Data Science: Challenges and Opportunities 2021 CIDR -
7,013 Qualitative Data Cleaning 2016 VLDB 4.8576683e-05