SCODED: Statistical Constraint Oriented Data Error Detection

Summary: SCODED uses Statistical Constraints (SCs) for data cleaning, aligning with integrity constraints for insight and downstream use. Two parts SC Violation Detection and Error Drill Down (topk); experiments on synthetic data show SCs beat latest methods. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h08a99c0bf82d486c
Venue: SIGMOD
Year: 2020
Pagerank: 8.5575299e-05
Overall Rank: 2,372 | 84.06%
DOI: 10.1145/3318464.3380568

Incoming Non-self Citations Over Time

Authors

1. Jing Nathan Yan (Cornell University; Simon Fraser University)
2. Oliver Schulte (Simon Fraser University)
3. MoHan Zhang (Simon Fraser University)
4. Jiannan Wang (Simon Fraser University)
5. Reynold Cheng (University of Hong Kong)

BibTeX Citation

@inproceedings{yan_sigmod20,
        title = {{SCODED: Statistical Constraint Oriented Data Error Detection}},
        author = {Yan, Jing Nathan and Schulte, Oliver and Zhang, MoHan and Wang, Jiannan and Cheng, Reynold},
        series = {{SIGMOD} '20},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3318464.3380568},
        url = {https://dl.acm.org/doi/10.1145/3318464.3380568},
        year = {2020}
}

Incoming Citations (Sorted by Pagerank)

Showing 17 of 17 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
2,642	Auto-Suggest: Learning-to-Recommend Data Preparation Steps Using Data Science Notebooks	2020	SIGMOD	8.1751637e-05
5,251	Enabling SQL-based Training Data Debugging for Federated Learning	2022	VLDB	6.2092359e-05
5,870	Leveraging Application Data Constraints to Optimize Database-Backed Web Applications	2023	VLDB	5.9620208e-05
6,482	OTClean: Data Cleaning for Conditional Independence Violations using Optimal Transport	2024	SIGMOD	5.7690673e-05
6,528	Parallel Discrepancy Detection and Incremental Detection	2021	VLDB	5.7540798e-05
7,185	DataPrism: Exposing Disconnect between Data and Systems	2022	SIGMOD	5.5890883e-05
7,476	Fast Detection of Denial Constraint Violations	2022	VLDB	5.5150385e-05
7,510	Conformance Constraint Discovery: Measuring Trust in Data-Driven Systems	2021	SIGMOD	5.504811e-05
7,531	Auto-Prep: Holistic Prediction of Data Preparation Steps for Self-Service Business Intelligence	2025	VLDB	5.4994676e-05
7,742	Auto-Validate: Unsupervised Data Validation Using Data-Domain Patterns Inferred from Data Lakes	2021	SIGMOD	5.4599258e-05
7,876	Rock: Cleaning Data by Embedding ML in Logic Rules	2024	SIGMOD	5.4336606e-05
7,917	CoCo: Interactive Exploration of Conformance Constraints for Data Understanding and Data Cleaning	2021	SIGMOD	5.4254123e-05
9,881	MTSClean: Efficient Constraint-based Cleaning for Multi-Dimensional Time Series Data	2024	VLDB	5.115241e-05
10,537	Guardrail: Automated Integrity Constraint Synthesis From Noisy Data	2026	SIGMOD	4.9769913e-05
10,540	Minimum Change ≠ Best Cleaning: Parallel and Incremental Error Detection under Integrity Constraints	2026	SIGMOD	4.9769913e-05
10,699	Stress-Testing Causal Claims via Cardinality Repairs	2026	SIGMOD	4.9769913e-05
11,000	SubCure: A System for Stress-Testing Causal Conclusions Using Cardinality Repairs	2026	VLDB	4.9769913e-05

Outgoing Citations (Sorted by Pagerank)

Showing 22 of 22 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
104	HoloClean: Holistic Data Repairs with Probabilistic Inference	2017	VLDB	0.00033676943
160	CORDS: Automatic Discovery of Correlations and Soft Functional Dependencies	2004	SIGMOD	0.00027827605
188	A Cost-Based Model and Effective Heuristic for Repairing Constraints by Value Modification	2005	SIGMOD	0.00025861123
190	Scorpion: Explaining Away Outliers in Aggregate Queries	2013	VLDB	0.0002582857
350	Discovering Denial Constraints	2013	VLDB	0.00020244085
548	ERACER: A Database Approach for Statistical Inference and Data Cleaning	2010	SIGMOD	0.00016572863
652	Don’t be SCAREd: Use SCalable Automatic REpairing with Maximal Likelihood and Bounded Changes	2013	SIGMOD	0.00015114401
671	A Formal Approach to Finding Explanations for Database Queries	2014	SIGMOD	0.00014948069
804	Interventional Fairness : Causal Database Repair for Algorithmic Fairness	2019	SIGMOD	0.00013830311
884	HoloDetect: Few-Shot Learning for Error Detection	2019	SIGMOD	0.00013263269
1,044	Data Cleaning: Overview and Emerging Challenges	2016	SIGMOD	0.00012329478
1,098	KATARA: A Data Cleaning System Powered by Knowledge Bases and Crowdsourcing	2015	SIGMOD	0.00012031983
1,344	Detecting Data Errors: Where are we and what needs to be done?	2016	VLDB	0.00010951939
1,805	Raha: A Configuration-Free Error Detection System	2019	SIGMOD	9.5938877e-05
2,355	Bias in OLAP Queries: Detection, Explanation, and Removal (Or Think Twice About Your AVG-Query)	2018	SIGMOD	8.5862478e-05
2,505	Query-Oriented Data Cleaning with Oracles	2015	SIGMOD	8.3743595e-05
2,687	Data X-Ray: A Diagnostic Tool for Data Errors	2015	SIGMOD	8.1271333e-05
2,748	Uni-Detect: A Unified Approach to Automated Error Detection in Tables	2019	SIGMOD	8.0572603e-05
2,962	Auto-Detect: Data-Driven Error Detection in Tables	2018	SIGMOD	7.8038782e-05
4,829	QFix: Diagnosing Errors through Query Histories	2017	SIGMOD	6.3887613e-05
5,882	ActiveClean: An Interactive Data Cleaning Framework For Modern Machine Learning	2016	SIGMOD	5.9560519e-05
6,492	HypDB: A Demonstration of Detecting, Explaining and Resolving Bias in OLAP queries	2018	VLDB	5.7647756e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	9,702	Constraint-Variance Tolerant Data Repairing	2016	SIGMOD
2	1,044	Data Cleaning: Overview and Emerging Challenges	2016	SIGMOD
3	652	Don’t be SCAREd: Use SCalable Automatic REpairing with Maximal Likelihood and Bounded Changes	2013	SIGMOD
4	7,476	Fast Detection of Denial Constraint Violations	2022	VLDB
5	1,915	Statistical Distortion: Consequences of Data Cleaning	2012	VLDB
6	1,344	Detecting Data Errors: Where are we and what needs to be done?	2016	VLDB
7	3,421	UGuide – User-Guided Discovery of FD-Detectable Errors	2017	SIGMOD
8	13,290	Enhancing Database Correctness: A Statistical Approach	1995	SIGMOD
9	10,540	Minimum Change ≠ Best Cleaning: Parallel and Incremental Error Detection under Integrity Constraints	2026	SIGMOD
10	9,239	Auto-Test: Learning Semantic-Domain Constraints for Unsupervised Error Detection in Tables	2025	SIGMOD