A Comprehensive Benchmark Framework for Active Learning Methods in Entity Matching

Summary: Unifies active learning for Entity Matching into a benchmark framework to compose learning and selection strategies. On public EM data, active learning with fewer labels can match or beat supervised results; optimizations boost F1 ~9% and cut latency up to 10x. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h678c8533b35c7648
Venue: SIGMOD
Year: 2020
Pagerank: 8.410678e-05
Overall Rank: 2,475 | 83.37%
DOI: 10.1145/3318464.3380597

Incoming Non-self Citations Over Time

Authors

1. Vamsi Meduri (Arizona State University)
2. Lucian Popa (IBM)
3. Prithviraj Sen (IBM)
4. Mohamed Sarwat (Arizona State University)

BibTeX Citation

@inproceedings{meduri_sigmod20,
        title = {{A Comprehensive Benchmark Framework for Active Learning Methods in Entity Matching}},
        author = {Meduri, Vamsi and Popa, Lucian and Sen, Prithviraj and Sarwat, Mohamed},
        series = {{SIGMOD} '20},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3318464.3380597},
        url = {https://dl.acm.org/doi/10.1145/3318464.3380597},
        year = {2020}
}

Incoming Citations (Sorted by Pagerank)

Showing 15 of 15 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
134	Deep Entity Matching with Pre-Trained Language Models	2021	VLDB	0.00030043481
4,676	Entity Resolution with Hierarchical Graph Attention Networks	2022	SIGMOD	6.4745561e-05
4,939	Deep Indexed Active Learning for Matching Heterogeneous Entity Representations	2022	VLDB	6.3458427e-05
5,076	Rotom: A Meta-Learned Data Augmentation Framework for Entity Matching, Data Cleaning, Text Classification, and Beyond	2021	SIGMOD	6.2860582e-05
7,068	How do Categorical Duplicates Affect ML? A New Benchmark and Empirical Analyses	2024	VLDB	5.6083188e-05
7,181	FlexER: Flexible Entity Resolution for Multiple Intents	2023	SIGMOD	5.5923113e-05
9,565	Deduplicated Sampling On-Demand	2025	VLDB	5.1571823e-05
9,785	The Battleship Approach to the Low Resource Entity Matching Problem	2023	SIGMOD	5.1283279e-05
10,112	Data Augmentation for ML-driven Data Preparation and Integration	2021	VLDB	5.0789354e-05
10,180	Progressive Entity Matching: A Design Space Exploration	2025	SIGMOD	5.0653015e-05
10,527	In-context Clustering-based Entity Resolution with Large Language Models: A Design Space Exploration	2026	SIGMOD	4.9793485e-05
11,738	Splitting Tuples of Mismatched Entities	2023	SIGMOD	4.9793485e-05
11,744	VersaMatch: Ontology Matching with Weak Supervision	2023	VLDB	4.9793485e-05
11,849	FILA: Online Auditing of Machine Learning Model Accuracy under Finite Labelling Budget	2022	SIGMOD	4.9793485e-05
11,943	New Algorithms for Monotone Classification	2021	PODS	4.9793485e-05

Outgoing Citations (Sorted by Pagerank)

Showing 15 of 15 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
158	Deep Learning for Entity Matching: A Design Space Exploration	2018	SIGMOD	0.00028046388
198	CrowdER: Crowdsourcing Entity Resolution	2012	VLDB	0.00025555196
244	Evaluation of entity resolution approaches on real-world match problems	2010	VLDB	0.00023314591
433	Corleone: Hands-Off Crowdsourcing for Entity Matching	2014	SIGMOD	0.00018332741
530	Magellan: Toward Building Entity Matching Management Systems	2016	VLDB	0.00016855162
534	On Active Learning of Record Matching Packages	2010	SIGMOD	0.0001680637
871	Leveraging Transitive Relations for Crowdsourced Joins	2013	SIGMOD	0.00013343705
933	Question Selection for Crowd Entity Resolution	2013	VLDB	0.00013004422
1,472	Crowdsourcing Algorithms for Entity Resolution	2014	VLDB	0.00010558263
1,493	Synthesizing Entity Matching Rules by Examples	2018	VLDB	0.00010505174
1,654	Falcon: Scaling Up Hands-Off Crowdsourced Entity Matching to Build Cloud Services	2017	SIGMOD	9.9739611e-05
2,642	Scaling Up Crowd-Sourcing to Very Large Datasets: A Case for Active Learning	2015	VLDB	8.1778168e-05
3,409	Waldo: An Adaptive Human Interface for Crowd Entity Resolution	2017	SIGMOD	7.3264601e-05
4,051	Crowd-Based Deduplication: An Adaptive Approach	2015	SIGMOD	6.8285415e-05
4,623	Cost-Effective Crowdsourced Entity Resolution: A Partial-Order Approach	2016	SIGMOD	6.4978811e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	5,705	Analyzing How BERT Performs Entity Matching	2022	VLDB
2	1,247	Entity Matching: How Similar Is Similar	2011	VLDB
3	10,210	Blocker and Matcher Can Mutually Benefit: A Co-Learning Framework for Low-Resource Entity Resolution	2024	VLDB
4	9,241	Deep Active Alignment of Knowledge Graph Entities and Schemata	2023	SIGMOD
5	12,198	Entity Matching with Active Monotone Classification	2018	PODS
6	4,148	A Benchmarking Study of Embedding-based Entity Alignment for Knowledge Graphs	2020	VLDB
7	9,785	The Battleship Approach to the Low Resource Entity Matching Problem	2023	SIGMOD
8	2,514	Deep Learning for Blocking in Entity Matching: A Design Space Exploration	2021	VLDB
9	158	Deep Learning for Entity Matching: A Design Space Exploration	2018	SIGMOD
10	9,708	Ground Truth Inference for Weakly Supervised Entity Matching	2023	SIGMOD