Auto-Detect: Data-Driven Error Detection in Tables

Summary: Auto-Detect uses co-occurrence statistics from corpora to detect errors in a column, beyond regexlike rules. An ensemble of generalization languages handles diverse errors via global statistics; Wikipedia tables and Excel validate; benchmark released. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h4df48f13497f6c29
Venue: SIGMOD
Year: 2018
Pagerank: 7.8038782e-05
Overall Rank: 2,962 | 80.10%
DOI: 10.1145/3183713.3196889

Incoming Non-self Citations Over Time

Authors

1. Zhipeng Huang (University of Hong Kong)
2. Yeye He (Microsoft)

BibTeX Citation

@inproceedings{huang_sigmod18,
        title = {{Auto-Detect: Data-Driven Error Detection in Tables}},
        author = {Huang, Zhipeng and He, Yeye},
        series = {{SIGMOD} '18},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3183713.3196889},
        url = {https://dl.acm.org/doi/10.1145/3183713.3196889},
        year = {2018}
}

Incoming Citations (Sorted by Pagerank)

Showing 18 of 18 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
884	HoloDetect: Few-Shot Learning for Error Detection	2019	SIGMOD	0.00013263269
1,977	Table-GPT: Table Fine-tuned GPT for Diverse Table Tasks	2024	SIGMOD	9.2760522e-05
2,372	SCODED: Statistical Constraint Oriented Data Error Detection	2020	SIGMOD	8.5575299e-05
2,642	Auto-Suggest: Learning-to-Recommend Data Preparation Steps Using Data Science Notebooks	2020	SIGMOD	8.1751637e-05
2,744	Transform-Data-by-Example (TDE): An Extensible Search Engine for Data Transformations	2018	VLDB	8.064168e-05
2,748	Uni-Detect: A Unified Approach to Automated Error Detection in Tables	2019	SIGMOD	8.0572603e-05
3,264	Automatic Data Repair: Are We Ready to Deploy?	2024	VLDB	7.4774357e-05
4,426	Auto-Transform: Learning-to-Transform by Patterns	2020	VLDB	6.601896e-05
4,845	Pattern Functional Dependencies for Data Cleaning	2020	VLDB	6.3808938e-05
5,391	ANMAT: Automatic Knowledge Discovery and Error Detection through Pattern Functional Dependencies	2019	SIGMOD	6.1495611e-05
7,531	Auto-Prep: Holistic Prediction of Data Preparation Steps for Self-Service Business Intelligence	2025	VLDB	5.4994676e-05
7,742	Auto-Validate: Unsupervised Data Validation Using Data-Domain Patterns Inferred from Data Lakes	2021	SIGMOD	5.4599258e-05
8,339	ICARUS: Minimizing Human Effort in Iterative Data Completion	2018	VLDB	5.3500594e-05
9,239	Auto-Test: Learning Semantic-Domain Constraints for Unsupervised Error Detection in Tables	2025	SIGMOD	5.2032182e-05
9,623	GIDCL: A Graph-Enhanced Interpretable Data Cleaning Framework with Large Language Models	2024	SIGMOD	5.1486163e-05
9,727	DataVinci: Learning Syntactic and Semantic String Repairs	2025	SIGMOD	5.1325223e-05
10,540	Minimum Change ≠ Best Cleaning: Parallel and Incremental Error Detection under Integrity Constraints	2026	SIGMOD	4.9769913e-05
10,878	DeepPrep: An LLM-Powered Agentic System for Autonomous Data Preparation	2026	VLDB	4.9769913e-05

Outgoing Citations (Sorted by Pagerank)

Showing 14 of 14 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
89	WebTables: Exploring the Power of Tables on the Web	2008	VLDB	0.00035115118
95	Potter's Wheel: An Interactive Data Cleaning System	2001	VLDB	0.00034367518
104	HoloClean: Holistic Data Repairs with Probabilistic Inference	2017	VLDB	0.00033676943
142	LOF: Identifying Density-Based Local Outliers	2000	SIGMOD	0.00029189529
160	CORDS: Automatic Discovery of Correlations and Soft Functional Dependencies	2004	SIGMOD	0.00027827605
350	Discovering Denial Constraints	2013	VLDB	0.00020244085
483	ActiveClean: Interactive Data Cleaning For Statistical Modeling	2016	VLDB	0.00017584249
695	Algorithms for Mining Distance-Based Outliers in Large Datasets	1998	VLDB	0.00014696154
1,098	KATARA: A Data Cleaning System Powered by Knowledge Bases and Crowdsourcing	2015	SIGMOD	0.00012031983
1,344	Detecting Data Errors: Where are we and what needs to be done?	2016	VLDB	0.00010951939
3,244	Inference of Concise DTDs from XML Data	2006	VLDB	7.4956321e-05
3,615	TEGRA: Table Extraction by Global Record Alignment	2015	SIGMOD	7.1558238e-05
4,204	SEMA-JOIN: Joining Semantically-Related Tables Using Big Table Corpora	2015	VLDB	6.7331936e-05
8,143	Synthesizing Mapping Relationships Using Table Corpus	2017	SIGMOD	5.3898955e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	526	Improving Data Quality: Consistency and Accuracy	2007	VLDB
2	3,264	Automatic Data Repair: Are We Ready to Deploy?	2024	VLDB
3	2,967	Towards Dependable Data Repairing with Fixing Rules	2014	SIGMOD
4	10,862	Auto-Fill: Learning to Predict Missing Values Accurately with Specialist Language Models	2026	VLDB
5	11,417	Demonstrating Matelda for Multi-Table Error Detection	2025	VLDB
6	2,613	Auto-Join: Joining Tables by Leveraging Transformations	2017	VLDB
7	7,742	Auto-Validate: Unsupervised Data Validation Using Data-Domain Patterns Inferred from Data Lakes	2021	SIGMOD
8	1,344	Detecting Data Errors: Where are we and what needs to be done?	2016	VLDB
9	9,239	Auto-Test: Learning Semantic-Domain Constraints for Unsupervised Error Detection in Tables	2025	SIGMOD
10	2,748	Uni-Detect: A Unified Approach to Automated Error Detection in Tables	2019	SIGMOD