Parallel Rule Discovery from Large Datasets by Sampling

Summary: Parallel rule discovery for REEs across tables via multi-round sampling with alpha precision and beta recall guarantees. Deep Q-learning selects predicates for multi-variable rules; tableau boosts recall; parallelization yields 12.2x speedups at 10% sample. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 6537
Venue: SIGMOD
Year: 2022
Pagerank: 5.1347137e-05
Overall Rank: 10,111 | 30.63%
DOI: 10.1145/3514221.3526165

Incoming Non-self Citations Over Time

Authors

1. Wenfei Fan (Beihang University; Shenzhen University; University of Edinburgh)
2. Ziyan Han (Beihang University)
3. Yaoshu Wang (Shenzhen University)
4. Min Xie (Shenzhen University)

BibTeX Citation

@inproceedings{fan_sigmod22,
        title = {{Parallel Rule Discovery from Large Datasets by Sampling}},
        author = {Fan, Wenfei and Han, Ziyan and Wang, Yaoshu and Xie, Min},
        series = {{SIGMOD} '22},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3514221.3526165},
        url = {https://dl.acm.org/doi/10.1145/3514221.3526165},
        year = {2022}
}

Incoming Citations (Sorted by Pagerank)

Showing 11 of 11 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
9,427	Discovering Top-k Rules using Subjective and Objective Criteria	2023	SIGMOD	5.271035e-05
9,437	GIDCL: A Graph-Enhanced Interpretable Data Cleaning Framework with Large Language Models	2024	SIGMOD	5.2687567e-05
9,647	Rock: Cleaning Data by Embedding ML in Logic Rules	2024	SIGMOD	5.2430158e-05
9,997	HyperBlocker: Accelerating Rule-based Blocking in Entity Resolution using GPUs	2025	VLDB	5.1814573e-05
9,999	Discovering Top-k Relevant and Diversified Rules	2024	SIGMOD	5.1814573e-05
10,324	Outliers: The Good, the Bad and the Ugly	2026	SIGMOD	5.093636e-05
10,766	Incremental Rule Discovery in Response to Parameter Updates	2025	SIGMOD	5.093636e-05
11,194	Enabling Adaptive Sampling for Intra-Window Join: Simultaneously Optimizing Quantity and Quality	2024	SIGMOD	5.093636e-05
11,212	Capturing More Associations by Referencing External Graphs	2024	VLDB	5.093636e-05
11,317	Rock: Cleaning Data with both ML and Logic Rules	2024	VLDB	5.093636e-05
11,424	Splitting Tuples of Mismatched Entities	2023	SIGMOD	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 20 of 20 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
33	Consistent Query Answers in Inconsistent Databases	1999	PODS	0.00049907763
112	HoloClean: Holistic Data Repairs with Probabilistic Inference	2017	VLDB	0.00032801121
141	Deep Entity Matching with Pre-Trained Language Models	2021	VLDB	0.0002964847
248	Evaluation of entity resolution approaches on real-world match problems	2010	VLDB	0.00023278354
376	Discovering Denial Constraints	2013	VLDB	0.00019677674
462	Sampling Large Databases for Association Rules	1996	VLDB	0.00018065337
618	A Hybrid Approach to Functional Dependency Discovery	2016	SIGMOD	0.00015711835
946	HoloDetect: Few-Shot Learning for Error Detection	2019	SIGMOD	0.00013054126
1,033	On Generating Near-Optimal Tableaux for Conditional Functional Dependencies	2008	VLDB	0.00012529852
1,465	Synthesizing Entity Matching Rules by Examples	2018	VLDB	0.00010689571
1,500	Efficient Discovery of Approximate Dependencies	2018	VLDB	0.00010561098
1,741	Efficient Denial Constraint Discovery with Hydra	2018	VLDB	9.8755846e-05
1,955	Discovery of Approximate (and Exact) Denial Constraints	2020	VLDB	9.4166032e-05
2,685	Approximate Denial Constraints	2020	VLDB	8.2594662e-05
3,441	A Statistical Perspective on Discovering Functional Dependencies in Noisy Data	2020	SIGMOD	7.4138323e-05
4,696	Error-bounded Sampling for Analytics on Big Sparse Data	2014	VLDB	6.557612e-05
4,757	Pattern Functional Dependencies for Data Cleaning	2020	VLDB	6.5220005e-05
5,052	Distributed implementations of dependency discovery algorithms	2019	VLDB	6.3846183e-05
5,391	MDedup: Duplicate Detection with Matching Dependencies	2020	VLDB	6.2343031e-05
7,330	Discovering Association Rules from Big Graphs	2022	VLDB	5.6435171e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	10,186	Accelerating Approximate Analytical Join Queries over Unstructured Data with Statistical Guarantees	2026	SIGMOD
2	456	Discovery of Multiple-Level Association Rules from Large Databases	1995	VLDB
3	3,732	Entity Resolution with Evolving Rules	2010	VLDB
4	462	Sampling Large Databases for Association Rules	1996	VLDB
5	10,766	Incremental Rule Discovery in Response to Parameter Updates	2025	SIGMOD
6	9,627	Making It Tractable to Catch Duplicates and Conflicts in Graphs	2023	SIGMOD
7	6,403	Parallel Discrepancy Detection and Incremental Detection	2021	VLDB
8	9,427	Discovering Top-k Rules using Subjective and Objective Criteria	2023	SIGMOD
9	9,999	Discovering Top-k Relevant and Diversified Rules	2024	SIGMOD
10	7,330	Discovering Association Rules from Big Graphs	2022	VLDB