HoloDetect: Few-Shot Learning for Error Detection

Summary: HoloDetect: few-shot error detection with a two-part model; rich representations and a data-augmentation policy learner. Augmenting a small seed of clean data yields ~94% precision, ~93% recall, ~20 F1 gains, and ~3x fewer labels than ML baselines. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 5762
Venue: SIGMOD
Year: 2019
Pagerank: 0.00013054126
Overall Rank: 946 | 93.52%
DOI: 10.1145/3299869.3319888

Incoming Non-self Citations Over Time

Authors

1. Alireza Heidari (University of Waterloo)
2. Joshua McGrath (University of Wisconsin)
3. Ihab F. Ilyas (University of Waterloo)
4. Theodoros Rekatsinas (University of Wisconsin)

BibTeX Citation

@inproceedings{heidari_sigmod19,
        title = {{HoloDetect: Few-Shot Learning for Error Detection}},
        author = {Heidari, Alireza and McGrath, Joshua and Ilyas, Ihab F. and Rekatsinas, Theodoros},
        series = {{SIGMOD} '19},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3299869.3319888},
        url = {https://dl.acm.org/doi/10.1145/3299869.3319888},
        year = {2019}
}

Incoming Citations (Sorted by Pagerank)

Showing 43 of 43 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
154	Neo: A Learned Query Optimizer	2019	VLDB	0.00028726181
420	Can Foundation Models Wrangle Your Data?	2023	VLDB	0.00018789852
1,476	Baran: Effective Error Correction via a Unified Context Representation and Transfer Learning	2020	VLDB	0.00010659277
1,756	SystemDS: A Declarative Machine Learning System for the End-to-End Data Science Lifecycle	2020	CIDR	9.8172465e-05
2,584	Complaint-driven Training Data Debugging for Query 2.0	2020	SIGMOD	8.3783546e-05
2,685	Approximate Denial Constraints	2020	VLDB	8.2594662e-05
2,744	Auto-Suggest: Learning-to-Recommend Data Preparation Steps Using Data Science Notebooks	2020	SIGMOD	8.1781662e-05
3,004	SCODED: Statistical Constraint Oriented Data Error Detection	2020	SIGMOD	7.8608629e-05
3,304	Saga: A Platform for Continuous Construction and Serving of Knowledge At Scale	2022	SIGMOD	7.5404346e-05
3,441	A Statistical Perspective on Discovering Functional Dependencies in Noisy Data	2020	SIGMOD	7.4138323e-05
3,580	Automatic Data Repair: Are We Ready to Deploy?	2024	VLDB	7.2888516e-05
4,130	PrIU: A Provenance-Based Approach for Incrementally Updating Regression Models	2020	SIGMOD	6.8839621e-05
4,412	Auto-Transform: Learning-to-Transform by Patterns	2020	VLDB	6.7168614e-05
4,966	Rotom: A Meta-Learned Data Augmentation Framework for Entity Matching, Data Cleaning, Text Classification, and Beyond	2021	SIGMOD	6.4225454e-05
5,131	Enabling SQL-based Training Data Debugging for Federated Learning	2022	VLDB	6.3537809e-05
5,835	Semi-Supervised Data Cleaning with Raha and Baran	2021	CIDR	6.0720263e-05
6,094	The Fast and the Private: Task-based Dataset Search	2024	CIDR	5.9786215e-05
6,403	Parallel Discrepancy Detection and Incremental Detection	2021	VLDB	5.8859374e-05
6,431	Finding Label and Model Errors in Perception Data With Learned Observation Assertions	2022	SIGMOD	5.8802622e-05
7,232	Saga: A Scalable Framework for Optimizing Data Cleaning Pipelines for Machine Learning Applications	2023	SIGMOD	5.6659017e-05
7,395	Automating and Optimizing Data-Centric What-If Analyses on Native Machine Learning Pipelines	2023	SIGMOD	5.6257796e-05
7,687	ExDRa: Exploratory Data Science on Federated Raw Data	2021	SIGMOD	5.5671645e-05
7,690	Auto-Validate: Unsupervised Data Validation Using Data-Domain Patterns Inferred from Data Lakes	2021	SIGMOD	5.5669307e-05
8,594	Exploratory Training: When Annotators Learn About Data	2023	SIGMOD	5.4053095e-05
9,177	VerifAI: Verified Generative AI	2024	CIDR	5.3078984e-05
9,380	Auto-Prep: Holistic Prediction of Data Preparation Steps for Self-Service Business Intelligence	2025	VLDB	5.2755515e-05
9,427	Discovering Top-k Rules using Subjective and Objective Criteria	2023	SIGMOD	5.271035e-05
9,437	GIDCL: A Graph-Enhanced Interpretable Data Cleaning Framework with Large Language Models	2024	SIGMOD	5.2687567e-05
9,539	DataVinci: Learning Syntactic and Semantic String Repairs	2025	SIGMOD	5.2528121e-05
9,627	Making It Tractable to Catch Duplicates and Conflicts in Graphs	2023	SIGMOD	5.2434488e-05
9,647	Rock: Cleaning Data by Embedding ML in Logic Rules	2024	SIGMOD	5.2430158e-05
9,699	MTSClean: Efficient Constraint-based Cleaning for Multi-Dimensional Time Series Data	2024	VLDB	5.2351259e-05
9,930	Data Augmentation for ML-driven Data Preparation and Integration	2021	VLDB	5.1955087e-05
10,001	Reptile: Aggregation-level Explanations for Hierarchical Data	2022	SIGMOD	5.1814573e-05
10,111	Parallel Rule Discovery from Large Datasets by Sampling	2022	SIGMOD	5.1347137e-05
10,131	Towards Scalable Visual Data Wrangling via Direct Manipulation	2026	CIDR	5.093636e-05
10,322	Minimum Change ≠ Best Cleaning: Parallel and Incremental Error Detection under Integrity Constraints	2026	SIGMOD	5.093636e-05
10,955	DobLIX: A Dual-Objective Learned Index for Log-Structured Merge Trees	2025	VLDB	5.093636e-05
10,966	UniClean: A Scalable Data Cleaning Solution for Mixed Errors based on Unified Cleaners and Optimized Cleaning Workflow	2025	VLDB	5.093636e-05
11,048	Demonstrating Matelda for Multi-Table Error Detection	2025	VLDB	5.093636e-05
11,211	MisDetect: Iterative Mislabel Detection using Early Loss	2024	VLDB	5.093636e-05
11,343	Generalizable Data Cleaning of Tabular Data in Latent Space	2024	VLDB	5.093636e-05
11,567	PGE: Robust Product Graph Embedding Learning for Error Detection	2022	VLDB	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 17 of 17 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
112	HoloClean: Holistic Data Repairs with Probabilistic Inference	2017	VLDB	0.00032801121
191	Scorpion: Explaining Away Outliers in Aggregate Queries	2013	VLDB	0.00026096009
205	Snorkel: Rapid Training Data Creation with Weak Supervision	2018	VLDB	0.00025235185
376	Discovering Denial Constraints	2013	VLDB	0.00019677674
516	Data Curation at Scale: The Data Tamer System	2013	CIDR	0.00017171198
725	NADEEF: A Commodity Data Cleaning System	2013	SIGMOD	0.00014617251
998	Towards Certain Fixes with Editing Rules and Master Data	2010	VLDB	0.0001275238
1,101	KATARA: A Data Cleaning System Powered by Knowledge Bases and Crowdsourcing	2015	SIGMOD	0.00012168934
1,351	Detecting Data Errors: Where are we and what needs to be done?	2016	VLDB	0.00011064851
1,914	Statistical Distortion: Consequences of Data Cleaning	2012	VLDB	9.4886927e-05
2,041	Combining Quantitative and Logical Data Cleaning	2016	VLDB	9.2692538e-05
2,142	Messing Up with BART: Error Generation for Evaluating Data-Cleaning Algorithms	2016	VLDB	9.0975882e-05
2,398	BigDansing: A System for Big Data Cleansing	2015	SIGMOD	8.631172e-05
2,981	Towards Dependable Data Repairing with Fixing Rules	2014	SIGMOD	7.8960114e-05
3,147	Auto-Detect: Data-Driven Error Detection in Tables	2018	SIGMOD	7.7077175e-05
4,598	Temporal Rules Discovery for Web Data Cleaning	2016	VLDB	6.6127851e-05
5,312	Explaining Repaired Data with CFDs	2018	VLDB	6.2698779e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	10,956	CoLA: Model Collaboration for Log-based Anomaly Detection	2025	VLDB
2	11,211	MisDetect: Iterative Mislabel Detection using Early Loss	2024	VLDB
3	5,835	Semi-Supervised Data Cleaning with Raha and Baran	2021	CIDR
4	2,297	Raha: A Configuration-Free Error Detection System	2019	SIGMOD
5	6,431	Finding Label and Model Errors in Perception Data With Learned Observation Assertions	2022	SIGMOD
6	10,785	Auto-Test: Learning Semantic-Domain Constraints for Unsupervised Error Detection in Tables	2025	SIGMOD
7	3,147	Auto-Detect: Data-Driven Error Detection in Tables	2018	SIGMOD
8	2,313	Active Learning for ML Enhanced Database Systems	2020	SIGMOD
9	1,351	Detecting Data Errors: Where are we and what needs to be done?	2016	VLDB
10	112	HoloClean: Holistic Data Repairs with Probabilistic Inference	2017	VLDB