Crowdsourcing Algorithms for Entity Resolution

Summary: Hybrid human–machine entity resolution on a probabilistic edge graph; designs query strategies to minimize expected human verifications by exploiting transitivity. Reveals that a claimed optimal strategy can be arbitrarily bad, offers provably guaranteed alternatives, and validates on public datasets and Facebook’s production system. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h45579e7ef497e788
Venue: VLDB
Year: 2014
Pagerank: 0.0001052886
Overall Rank: 1,473 | 90.13%
DOI: 10.14778/2732977.2732985
PDF: Download (CC BY-NC-ND 3.0)

Incoming Non-self Citations Over Time

Authors

1. Norases Vesdapunt (Stanford University)
2. Kedar Bellare (Meta)
3. Nilesh Dalvi (Meta)

BibTeX Citation

@article{vesdapunt_vldb14,
        title = {{Crowdsourcing Algorithms for Entity Resolution}},
        author = {Vesdapunt, Norases and Bellare, Kedar and Dalvi, Nilesh},
        journal = {PVLDB},
        series = {{VLDB} '14},
        volume = {7},
        number = {12},
        pages = {1071--1082},
        doi = {10.14778/2732977.2732985},
        url = {https://doi.org/10.14778/2732977.2732985},
        year = {2014}
}

Incoming Citations (Sorted by Pagerank)

Showing 25 of 25 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,650	Falcon: Scaling Up Hands-Off Crowdsourced Entity Matching to Build Cloud Services	2017	SIGMOD	9.9690948e-05
2,476	A Comprehensive Benchmark Framework for Active Learning Methods in Entity Matching	2020	SIGMOD	8.3932405e-05
3,414	Waldo: An Adaptive Human Interface for Crowd Entity Resolution	2017	SIGMOD	7.3058225e-05
3,672	Online Entity Resolution Using an Oracle	2016	VLDB	7.0926043e-05
4,074	Crowd-Based Deduplication: An Adaptive Approach	2015	SIGMOD	6.8062505e-05
4,626	Cost-Effective Crowdsourced Entity Resolution: A Partial-Order Approach	2016	SIGMOD	6.480594e-05
5,070	BEER: Blocking for Effective Entity Resolution	2021	SIGMOD	6.2760011e-05
5,586	Efficient Algorithms for Crowd-Aided Categorization	2020	VLDB	6.0582193e-05
6,644	Budget Constrained Interactive Search for Multiple Targets	2021	VLDB	5.7057955e-05
6,791	Crowdsourced Data Management: Overview and Challenges	2017	SIGMOD	5.6647309e-05
7,074	Cost-Effective Data Annotation using Game-Based Crowdsourcing	2019	VLDB	5.5915502e-05
7,601	Robust Entity Resolution using Random Graphs	2018	SIGMOD	5.4714372e-05
7,839	Towards Globally Optimal Crowdsourcing Quality Management: The Uniform Worker Setting	2016	SIGMOD	5.4264161e-05
7,903	Subjective Knowledge Base Construction Powered By Crowdsourcing and Knowledge Base	2018	SIGMOD	5.4135034e-05
9,617	CDB: Optimizing Queries with Crowd-Based Selections and Joins	2017	SIGMOD	5.1376962e-05
10,047	Hierarchical Entity Resolution using an Oracle	2022	SIGMOD	5.0786422e-05
10,049	How to Design Robust Algorithms using Noisy Comparison Oracle	2021	VLDB	5.0786422e-05
10,081	CrowdDQS: Dynamic Question Selection in Crowdsourcing Systems	2017	SIGMOD	5.0732737e-05
10,217	Progressive Entity Matching: A Design Space Exploration	2025	SIGMOD	5.0461625e-05
10,280	Towards Interpretable and Learnable Risk Analysis for Entity Resolution	2020	SIGMOD	5.0334833e-05
10,604	In-context Clustering-based Entity Resolution with Large Language Models: A Design Space Exploration	2026	SIGMOD	4.9605343e-05
10,651	LLM-Powered Interactive Graph Search: A Scalable and Practical Approach	2026	SIGMOD	4.9605343e-05
11,344	Evaluating Methods for Efficient Entity Count Estimation	2025	VLDB	4.9605343e-05
11,998	Approximation Algorithms for Large Scale Data Analysis	2021	PODS	4.9605343e-05
12,284	A Demonstration of PERC: Probabilistic Entity Resolution With Crowd Errors	2018	VLDB	4.9605343e-05

Outgoing Citations (Sorted by Pagerank)

Showing 5 of 5 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
199	CrowdER: Crowdsourcing Entity Resolution	2012	VLDB	0.0002551523
266	Human-powered Sorts and Joins	2012	VLDB	0.00022701006
873	Leveraging Transitive Relations for Crowdsourced Joins	2013	SIGMOD	0.00013306946
932	Question Selection for Crowd Entity Resolution	2013	VLDB	0.00012981731
4,537	Arnold: Declarative Crowd-Machine Data Integration	2013	CIDR	6.5399966e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	5,627	CrowdQ: Crowdsourced Query Understanding	2013	CIDR
2	3,414	Waldo: An Adaptive Human Interface for Crowd Entity Resolution	2017	SIGMOD
3	3,028	Truth Inference in Crowdsourcing: Is the Problem Solved?	2017	VLDB
4	873	Leveraging Transitive Relations for Crowdsourced Joins	2013	SIGMOD
5	6,404	Human-in-the-loop Data Integration	2017	VLDB
6	12,284	A Demonstration of PERC: Probabilistic Entity Resolution With Crowd Errors	2018	VLDB
7	4,626	Cost-Effective Crowdsourced Entity Resolution: A Partial-Order Approach	2016	SIGMOD
8	199	CrowdER: Crowdsourcing Entity Resolution	2012	VLDB
9	7,601	Robust Entity Resolution using Random Graphs	2018	SIGMOD
10	932	Question Selection for Crowd Entity Resolution	2013	VLDB