Crowdsourcing Algorithms for Entity Resolution

Summary: Hybrid human–machine entity resolution on a probabilistic edge graph; designs query strategies to minimize expected human verifications by exploiting transitivity. Reveals that a claimed optimal strategy can be arbitrarily bad, offers provably guaranteed alternatives, and validates on public datasets and Facebook’s production system. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h45579e7ef497e788
Venue: VLDB
Year: 2014
Pagerank: 0.00010553304
Overall Rank: 1,472 | 90.11%
DOI: 10.14778/2732977.2732985
PDF: Download (CC BY-NC-ND 3.0)

Incoming Non-self Citations Over Time

Authors

1. Norases Vesdapunt (Stanford University)
2. Kedar Bellare (Meta)
3. Nilesh Dalvi (Meta)

BibTeX Citation

@article{vesdapunt_vldb14,
        title = {{Crowdsourcing Algorithms for Entity Resolution}},
        author = {Vesdapunt, Norases and Bellare, Kedar and Dalvi, Nilesh},
        journal = {PVLDB},
        series = {{VLDB} '14},
        volume = {7},
        number = {12},
        pages = {1071--1082},
        doi = {10.14778/2732977.2732985},
        url = {https://doi.org/10.14778/2732977.2732985},
        year = {2014}
}

Incoming Citations (Sorted by Pagerank)

Showing 25 of 25 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,655	Falcon: Scaling Up Hands-Off Crowdsourced Entity Matching to Build Cloud Services	2017	SIGMOD	9.9694129e-05
2,475	A Comprehensive Benchmark Framework for Active Learning Methods in Entity Matching	2020	SIGMOD	8.4074448e-05
3,409	Waldo: An Adaptive Human Interface for Crowd Entity Resolution	2017	SIGMOD	7.3230153e-05
3,666	Online Entity Resolution Using an Oracle	2016	VLDB	7.1151622e-05
4,053	Crowd-Based Deduplication: An Adaptive Approach	2015	SIGMOD	6.8253348e-05
4,625	Cost-Effective Crowdsourced Entity Resolution: A Partial-Order Approach	2016	SIGMOD	6.4948389e-05
5,052	BEER: Blocking for Effective Entity Resolution	2021	SIGMOD	6.2949299e-05
5,572	Efficient Algorithms for Crowd-Aided Categorization	2020	VLDB	6.078318e-05
6,633	Budget Constrained Interactive Search for Multiple Targets	2021	VLDB	5.724725e-05
7,054	Cost-Effective Data Annotation using Game-Based Crowdsourcing	2019	VLDB	5.6101007e-05
7,505	Crowdsourced Data Management: Overview and Challenges	2017	SIGMOD	5.5057737e-05
7,822	Towards Globally Optimal Crowdsourcing Quality Management: The Uniform Worker Setting	2016	SIGMOD	5.4444136e-05
7,889	Subjective Knowledge Base Construction Powered By Crowdsourcing and Knowledge Base	2018	SIGMOD	5.4312213e-05
8,335	Robust Entity Resolution using Random Graphs	2018	SIGMOD	5.35117e-05
9,591	CDB: Optimizing Queries with Crowd-Based Selections and Joins	2017	SIGMOD	5.154741e-05
10,011	Hierarchical Entity Resolution using an Oracle	2022	SIGMOD	5.0954911e-05
10,013	How to Design Robust Algorithms using Noisy Comparison Oracle	2021	VLDB	5.0954911e-05
10,042	CrowdDQS: Dynamic Question Selection in Crowdsourcing Systems	2017	SIGMOD	5.0901047e-05
10,184	Progressive Entity Matching: A Design Space Exploration	2025	SIGMOD	5.0629036e-05
10,250	Towards Interpretable and Learnable Risk Analysis for Entity Resolution	2020	SIGMOD	5.0501823e-05
10,538	In-context Clustering-based Entity Resolution with Large Language Models: A Design Space Exploration	2026	SIGMOD	4.9769913e-05
10,589	LLM-Powered Interactive Graph Search: A Scalable and Practical Approach	2026	SIGMOD	4.9769913e-05
11,288	Evaluating Methods for Efficient Entity Count Estimation	2025	VLDB	4.9769913e-05
11,954	Approximation Algorithms for Large Scale Data Analysis	2021	PODS	4.9769913e-05
12,241	A Demonstration of PERC: Probabilistic Entity Resolution With Crowd Errors	2018	VLDB	4.9769913e-05

Outgoing Citations (Sorted by Pagerank)

Showing 5 of 5 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
198	CrowdER: Crowdsourcing Entity Resolution	2012	VLDB	0.00025546182
266	Human-powered Sorts and Joins	2012	VLDB	0.00022735106
871	Leveraging Transitive Relations for Crowdsourced Joins	2013	SIGMOD	0.00013338722
934	Question Selection for Crowd Entity Resolution	2013	VLDB	0.00012998402
4,519	Arnold: Declarative Crowd-Machine Data Integration	2013	CIDR	6.5602428e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	5,615	CrowdQ: Crowdsourced Query Understanding	2013	CIDR
2	3,409	Waldo: An Adaptive Human Interface for Crowd Entity Resolution	2017	SIGMOD
3	3,173	Truth Inference in Crowdsourcing: Is the Problem Solved?	2017	VLDB
4	871	Leveraging Transitive Relations for Crowdsourced Joins	2013	SIGMOD
5	6,400	Human-in-the-loop Data Integration	2017	VLDB
6	12,241	A Demonstration of PERC: Probabilistic Entity Resolution With Crowd Errors	2018	VLDB
7	4,625	Cost-Effective Crowdsourced Entity Resolution: A Partial-Order Approach	2016	SIGMOD
8	198	CrowdER: Crowdsourcing Entity Resolution	2012	VLDB
9	8,335	Robust Entity Resolution using Random Graphs	2018	SIGMOD
10	934	Question Selection for Crowd Entity Resolution	2013	VLDB