Auto-Detect: Data-Driven Error Detection in Tables

Summary: Auto-Detect uses co-occurrence statistics from corpora to detect errors in a column, beyond regexlike rules. An ensemble of generalization languages handles diverse errors via global statistics; Wikipedia tables and Excel validate; benchmark released. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h4df48f13497f6c29
Venue: SIGMOD
Year: 2018
Pagerank: 7.8075103e-05
Overall Rank: 2,960 | 80.10%
DOI: 10.1145/3183713.3196889

Incoming Non-self Citations Over Time

Authors

1. Zhipeng Huang (University of Hong Kong)
2. Yeye He (Microsoft)

BibTeX Citation

@inproceedings{huang_sigmod18,
        title = {{Auto-Detect: Data-Driven Error Detection in Tables}},
        author = {Huang, Zhipeng and He, Yeye},
        series = {{SIGMOD} '18},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3183713.3196889},
        url = {https://dl.acm.org/doi/10.1145/3183713.3196889},
        year = {2018}
}

Incoming Citations (Sorted by Pagerank)

Showing 18 of 18 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
883	HoloDetect: Few-Shot Learning for Error Detection	2019	SIGMOD	0.00013268059
1,978	Table-GPT: Table Fine-tuned GPT for Diverse Table Tasks	2024	SIGMOD	9.2730152e-05
2,371	SCODED: Statistical Constraint Oriented Data Error Detection	2020	SIGMOD	8.5615698e-05
2,641	Auto-Suggest: Learning-to-Recommend Data Preparation Steps Using Data Science Notebooks	2020	SIGMOD	8.1787073e-05
2,745	Transform-Data-by-Example (TDE): An Extensible Search Engine for Data Transformations	2018	VLDB	8.0668395e-05
2,748	Uni-Detect: A Unified Approach to Automated Error Detection in Tables	2019	SIGMOD	8.0610697e-05
3,263	Automatic Data Repair: Are We Ready to Deploy?	2024	VLDB	7.4809771e-05
4,424	Auto-Transform: Learning-to-Transform by Patterns	2020	VLDB	6.6048065e-05
4,843	Pattern Functional Dependencies for Data Cleaning	2020	VLDB	6.3839159e-05
5,384	ANMAT: Automatic Knowledge Discovery and Error Detection through Pattern Functional Dependencies	2019	SIGMOD	6.1524649e-05
7,526	Auto-Prep: Holistic Prediction of Data Preparation Steps for Self-Service Business Intelligence	2025	VLDB	5.5020723e-05
7,738	Auto-Validate: Unsupervised Data Validation Using Data-Domain Patterns Inferred from Data Lakes	2021	SIGMOD	5.4623434e-05
8,335	ICARUS: Minimizing Human Effort in Iterative Data Completion	2018	VLDB	5.3525933e-05
9,229	Auto-Test: Learning Semantic-Domain Constraints for Unsupervised Error Detection in Tables	2025	SIGMOD	5.2056825e-05
9,616	GIDCL: A Graph-Enhanced Interpretable Data Cleaning Framework with Large Language Models	2024	SIGMOD	5.1510548e-05
9,722	DataVinci: Learning Syntactic and Semantic String Repairs	2025	SIGMOD	5.1349531e-05
10,529	Minimum Change ≠ Best Cleaning: Parallel and Incremental Error Detection under Integrity Constraints	2026	SIGMOD	4.9793485e-05
10,869	DeepPrep: An LLM-Powered Agentic System for Autonomous Data Preparation	2026	VLDB	4.9793485e-05

Outgoing Citations (Sorted by Pagerank)

Showing 14 of 14 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
89	WebTables: Exploring the Power of Tables on the Web	2008	VLDB	0.00035129658
95	Potter's Wheel: An Interactive Data Cleaning System	2001	VLDB	0.00034382643
104	HoloClean: Holistic Data Repairs with Probabilistic Inference	2017	VLDB	0.00033690989
142	LOF: Identifying Density-Based Local Outliers	2000	SIGMOD	0.00029202746
160	CORDS: Automatic Discovery of Correlations and Soft Functional Dependencies	2004	SIGMOD	0.00027837289
350	Discovering Denial Constraints	2013	VLDB	0.00020253521
483	ActiveClean: Interactive Data Cleaning For Statistical Modeling	2016	VLDB	0.00017590977
695	Algorithms for Mining Distance-Based Outliers in Large Datasets	1998	VLDB	0.00014702685
1,099	KATARA: A Data Cleaning System Powered by Knowledge Bases and Crowdsourcing	2015	SIGMOD	0.00012037058
1,344	Detecting Data Errors: Where are we and what needs to be done?	2016	VLDB	0.00010956518
3,242	Inference of Concise DTDs from XML Data	2006	VLDB	7.4991762e-05
3,615	TEGRA: Table Extraction by Global Record Alignment	2015	SIGMOD	7.1591776e-05
4,206	SEMA-JOIN: Joining Semantically-Related Tables Using Big Table Corpora	2015	VLDB	6.7348167e-05
8,144	Synthesizing Mapping Relationships Using Table Corpus	2017	SIGMOD	5.3910618e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	526	Improving Data Quality: Consistency and Accuracy	2007	VLDB
2	3,263	Automatic Data Repair: Are We Ready to Deploy?	2024	VLDB
3	2,964	Towards Dependable Data Repairing with Fixing Rules	2014	SIGMOD
4	10,853	Auto-Fill: Learning to Predict Missing Values Accurately with Specialist Language Models	2026	VLDB
5	11,411	Demonstrating Matelda for Multi-Table Error Detection	2025	VLDB
6	2,612	Auto-Join: Joining Tables by Leveraging Transformations	2017	VLDB
7	7,738	Auto-Validate: Unsupervised Data Validation Using Data-Domain Patterns Inferred from Data Lakes	2021	SIGMOD
8	1,344	Detecting Data Errors: Where are we and what needs to be done?	2016	VLDB
9	9,229	Auto-Test: Learning Semantic-Domain Constraints for Unsupervised Error Detection in Tables	2025	SIGMOD
10	2,748	Uni-Detect: A Unified Approach to Automated Error Detection in Tables	2019	SIGMOD