Auto-Detect: Data-Driven Error Detection in Tables

Summary: Auto-Detect uses co-occurrence statistics from corpora to detect errors in a column, beyond regexlike rules. An ensemble of generalization languages handles diverse errors via global statistics; Wikipedia tables and Excel validate; benchmark released. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h4df48f13497f6c29
Venue: SIGMOD
Year: 2018
Pagerank: 7.7967245e-05
Overall Rank: 2,960 | 80.16%
DOI: 10.1145/3183713.3196889

Incoming Non-self Citations Over Time

Authors

1. Zhipeng Huang (University of Hong Kong)
2. Yeye He (Microsoft)

BibTeX Citation

@inproceedings{huang_sigmod18,
        title = {{Auto-Detect: Data-Driven Error Detection in Tables}},
        author = {Huang, Zhipeng and He, Yeye},
        series = {{SIGMOD} '18},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3183713.3196889},
        url = {https://dl.acm.org/doi/10.1145/3183713.3196889},
        year = {2018}
}

Incoming Citations (Sorted by Pagerank)

Showing 18 of 18 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
853	HoloDetect: Few-Shot Learning for Error Detection	2019	SIGMOD	0.00013437314
1,669	Table-GPT: Table Fine-tuned GPT for Diverse Table Tasks	2024	SIGMOD	9.9157758e-05
2,373	SCODED: Statistical Constraint Oriented Data Error Detection	2020	SIGMOD	8.5434538e-05
2,645	Auto-Suggest: Learning-to-Recommend Data Preparation Steps Using Data Science Notebooks	2020	SIGMOD	8.1641056e-05
2,746	Transform-Data-by-Example (TDE): An Extensible Search Engine for Data Transformations	2018	VLDB	8.0458815e-05
2,752	Uni-Detect: A Unified Approach to Automated Error Detection in Tables	2019	SIGMOD	8.0387193e-05
3,277	Automatic Data Repair: Are We Ready to Deploy?	2024	VLDB	7.4527106e-05
4,444	Auto-Transform: Learning-to-Transform by Patterns	2020	VLDB	6.5812416e-05
4,538	Pattern Functional Dependencies for Data Cleaning	2020	VLDB	6.5398994e-05
5,371	ANMAT: Automatic Knowledge Discovery and Error Detection through Pattern Functional Dependencies	2019	SIGMOD	6.1428928e-05
7,548	Auto-Prep: Holistic Prediction of Data Preparation Steps for Self-Service Business Intelligence	2025	VLDB	5.481283e-05
7,755	Auto-Validate: Unsupervised Data Validation Using Data-Domain Patterns Inferred from Data Lakes	2021	SIGMOD	5.4424293e-05
8,352	ICARUS: Minimizing Human Effort in Iterative Data Completion	2018	VLDB	5.3323688e-05
9,263	Auto-Test: Learning Semantic-Domain Constraints for Unsupervised Error Detection in Tables	2025	SIGMOD	5.1860131e-05
9,634	GIDCL: A Graph-Enhanced Interpretable Data Cleaning Framework with Large Language Models	2024	SIGMOD	5.1354312e-05
9,758	DataVinci: Learning Syntactic and Semantic String Repairs	2025	SIGMOD	5.115551e-05
10,606	Minimum Change ≠ Best Cleaning: Parallel and Incremental Error Detection under Integrity Constraints	2026	SIGMOD	4.9605343e-05
10,939	DeepPrep: An LLM-Powered Agentic System for Autonomous Data Preparation	2026	VLDB	4.9605343e-05

Outgoing Citations (Sorted by Pagerank)

Showing 14 of 14 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
88	WebTables: Exploring the Power of Tables on the Web	2008	VLDB	0.00035500667
95	Potter's Wheel: An Interactive Data Cleaning System	2001	VLDB	0.00034319763
100	HoloClean: Holistic Data Repairs with Probabilistic Inference	2017	VLDB	0.00033951027
143	LOF: Identifying Density-Based Local Outliers	2000	SIGMOD	0.00029095978
160	CORDS: Automatic Discovery of Correlations and Soft Functional Dependencies	2004	SIGMOD	0.00027775994
348	Discovering Denial Constraints	2013	VLDB	0.00020216677
460	ActiveClean: Interactive Data Cleaning For Statistical Modeling	2016	VLDB	0.00017836918
698	Algorithms for Mining Distance-Based Outliers in Large Datasets	1998	VLDB	0.0001465073
1,099	KATARA: A Data Cleaning System Powered by Knowledge Bases and Crowdsourcing	2015	SIGMOD	0.00012008783
1,306	Detecting Data Errors: Where are we and what needs to be done?	2016	VLDB	0.00011076619
3,260	Inference of Concise DTDs from XML Data	2006	VLDB	7.4717337e-05
3,618	TEGRA: Table Extraction by Global Record Alignment	2015	SIGMOD	7.1365624e-05
4,220	SEMA-JOIN: Joining Semantically-Related Tables Using Big Table Corpora	2015	VLDB	6.7137538e-05
8,158	Synthesizing Mapping Relationships Using Table Corpus	2017	SIGMOD	5.3726245e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	527	Improving Data Quality: Consistency and Accuracy	2007	VLDB
2	3,277	Automatic Data Repair: Are We Ready to Deploy?	2024	VLDB
3	2,958	Towards Dependable Data Repairing with Fixing Rules	2014	SIGMOD
4	10,923	Auto-Fill: Learning to Predict Missing Values Accurately with Specialist Language Models	2026	VLDB
5	11,470	Demonstrating Matelda for Multi-Table Error Detection	2025	VLDB
6	2,608	Auto-Join: Joining Tables by Leveraging Transformations	2017	VLDB
7	7,755	Auto-Validate: Unsupervised Data Validation Using Data-Domain Patterns Inferred from Data Lakes	2021	SIGMOD
8	1,306	Detecting Data Errors: Where are we and what needs to be done?	2016	VLDB
9	9,263	Auto-Test: Learning Semantic-Domain Constraints for Unsupervised Error Detection in Tables	2025	SIGMOD
10	2,752	Uni-Detect: A Unified Approach to Automated Error Detection in Tables	2019	SIGMOD