Auto-Detect: Data-Driven Error Detection in Tables

Summary: Auto-Detect uses co-occurrence statistics from corpora to detect errors in a column, beyond regexlike rules. An ensemble of generalization languages handles diverse errors via global statistics; Wikipedia tables and Excel validate; benchmark released. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 5597
Venue: SIGMOD
Year: 2018
Pagerank: 7.7077175e-05
Overall Rank: 3,147 | 78.42%
DOI: 10.1145/3183713.3196889

Incoming Non-self Citations Over Time

Authors

1. Zhipeng Huang (University of Hong Kong)
2. Yeye He (Microsoft)

BibTeX Citation

@inproceedings{huang_sigmod18,
        title = {{Auto-Detect: Data-Driven Error Detection in Tables}},
        author = {Huang, Zhipeng and He, Yeye},
        series = {{SIGMOD} '18},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3183713.3196889},
        url = {https://dl.acm.org/doi/10.1145/3183713.3196889},
        year = {2018}
}

Incoming Citations (Sorted by Pagerank)

Showing 17 of 17 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
946	HoloDetect: Few-Shot Learning for Error Detection	2019	SIGMOD	0.00013054126
2,099	Table-GPT: Table Fine-tuned GPT for Diverse Table Tasks	2024	SIGMOD	9.1682353e-05
2,728	Uni-Detect: A Unified Approach to Automated Error Detection in Tables	2019	SIGMOD	8.1995954e-05
2,744	Auto-Suggest: Learning-to-Recommend Data Preparation Steps Using Data Science Notebooks	2020	SIGMOD	8.1781662e-05
2,978	Transform-Data-by-Example (TDE): An Extensible Search Engine for Data Transformations	2018	VLDB	7.9030989e-05
3,004	SCODED: Statistical Constraint Oriented Data Error Detection	2020	SIGMOD	7.8608629e-05
3,580	Automatic Data Repair: Are We Ready to Deploy?	2024	VLDB	7.2888516e-05
4,412	Auto-Transform: Learning-to-Transform by Patterns	2020	VLDB	6.7168614e-05
4,757	Pattern Functional Dependencies for Data Cleaning	2020	VLDB	6.5220005e-05
5,268	ANMAT: Automatic Knowledge Discovery and Error Detection through Pattern Functional Dependencies	2019	SIGMOD	6.2923403e-05
7,690	Auto-Validate: Unsupervised Data Validation Using Data-Domain Patterns Inferred from Data Lakes	2021	SIGMOD	5.5669307e-05
8,160	ICARUS: Minimizing Human Effort in Iterative Data Completion	2018	VLDB	5.4754476e-05
9,380	Auto-Prep: Holistic Prediction of Data Preparation Steps for Self-Service Business Intelligence	2025	VLDB	5.2755515e-05
9,437	GIDCL: A Graph-Enhanced Interpretable Data Cleaning Framework with Large Language Models	2024	SIGMOD	5.2687567e-05
9,539	DataVinci: Learning Syntactic and Semantic String Repairs	2025	SIGMOD	5.2528121e-05
10,322	Minimum Change ≠ Best Cleaning: Parallel and Incremental Error Detection under Integrity Constraints	2026	SIGMOD	5.093636e-05
10,785	Auto-Test: Learning Semantic-Domain Constraints for Unsupervised Error Detection in Tables	2025	SIGMOD	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 14 of 14 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
91	WebTables: Exploring the Power of Tables on the Web	2008	VLDB	0.00034838835
94	Potter's Wheel: An Interactive Data Cleaning System	2001	VLDB	0.00034616103
112	HoloClean: Holistic Data Repairs with Probabilistic Inference	2017	VLDB	0.00032801121
142	LOF: Identifying Density-Based Local Outliers	2000	SIGMOD	0.0002962566
159	CORDS: Automatic Discovery of Correlations and Soft Functional Dependencies	2004	SIGMOD	0.00028129426
376	Discovering Denial Constraints	2013	VLDB	0.00019677674
582	ActiveClean: Interactive Data Cleaning For Statistical Modeling	2016	VLDB	0.00016148948
693	Algorithms for Mining Distance-Based Outliers in Large Datasets	1998	VLDB	0.00014918477
1,101	KATARA: A Data Cleaning System Powered by Knowledge Bases and Crowdsourcing	2015	SIGMOD	0.00012168934
1,351	Detecting Data Errors: Where are we and what needs to be done?	2016	VLDB	0.00011064851
3,185	Inference of Concise DTDs from XML Data	2006	VLDB	7.6567423e-05
3,574	TEGRA: Table Extraction by Global Record Alignment	2015	SIGMOD	7.2958137e-05
4,525	SEMA-JOIN: Joining Semantically-Related Tables Using Big Table Corpora	2015	VLDB	6.6456999e-05
8,491	Synthesizing Mapping Relationships Using Table Corpus	2017	SIGMOD	5.414689e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	10,322	Minimum Change ≠ Best Cleaning: Parallel and Incremental Error Detection under Integrity Constraints	2026	SIGMOD
2	533	Improving Data Quality: Consistency and Accuracy	2007	VLDB
3	3,580	Automatic Data Repair: Are We Ready to Deploy?	2024	VLDB
4	2,981	Towards Dependable Data Repairing with Fixing Rules	2014	SIGMOD
5	11,048	Demonstrating Matelda for Multi-Table Error Detection	2025	VLDB
6	2,980	Auto-Join: Joining Tables by Leveraging Transformations	2017	VLDB
7	7,690	Auto-Validate: Unsupervised Data Validation Using Data-Domain Patterns Inferred from Data Lakes	2021	SIGMOD
8	1,351	Detecting Data Errors: Where are we and what needs to be done?	2016	VLDB
9	10,785	Auto-Test: Learning Semantic-Domain Constraints for Unsupervised Error Detection in Tables	2025	SIGMOD
10	2,728	Uni-Detect: A Unified Approach to Automated Error Detection in Tables	2019	SIGMOD