Crowdsourcing Algorithms for Entity Resolution

Summary: Hybrid human–machine entity resolution on a probabilistic edge graph; designs query strategies to minimize expected human verifications by exploiting transitivity. Reveals that a claimed optimal strategy can be arbitrarily bad, offers provably guaranteed alternatives, and validates on public datasets and Facebook’s production system. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 10955
Venue: VLDB
Year: 2014
Pagerank: 0.00010773106
Overall Rank: 1,443 | 90.11%
DOI: 10.14778/2732977.2732985

Incoming Non-self Citations Over Time

Authors

1. Norases Vesdapunt (Stanford University)
2. Kedar Bellare (Meta)
3. Nilesh Dalvi (Meta)

BibTeX Citation

@article{vesdapunt_vldb14,
        title = {{Crowdsourcing Algorithms for Entity Resolution}},
        author = {Vesdapunt, Norases and Bellare, Kedar and Dalvi, Nilesh},
        journal = {PVLDB},
        series = {{VLDB} '14},
        volume = {7},
        number = {12},
        pages = {1071--1082},
        doi = {10.14778/2732977.2732985},
        url = {https://doi.org/10.14778/2732977.2732985},
        year = {2014}
}

Incoming Citations (Sorted by Pagerank)

Showing 25 of 25 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,643	Falcon: Scaling Up Hands-Off Crowdsourced Entity Matching to Build Cloud Services	2017	SIGMOD	0.00010134956
2,463	A Comprehensive Benchmark Framework for Active Learning Methods in Entity Matching	2020	SIGMOD	8.5486912e-05
3,496	Waldo: An Adaptive Human Interface for Crowd Entity Resolution	2017	SIGMOD	7.3634471e-05
3,602	Online Entity Resolution Using an Oracle	2016	VLDB	7.2691521e-05
3,983	Crowd-Based Deduplication: An Adaptive Approach	2015	SIGMOD	6.9739851e-05
4,538	Cost-Effective Crowdsourced Entity Resolution: A Partial-Order Approach	2016	SIGMOD	6.6404776e-05
4,940	BEER: Blocking for Effective Entity Resolution	2021	SIGMOD	6.4336209e-05
5,813	Efficient Algorithms for Crowd-Aided Categorization	2020	VLDB	6.0780519e-05
6,908	Cost-Effective Data Annotation using Game-Based Crowdsourcing	2019	VLDB	5.7415834e-05
7,021	Budget Constrained Interactive Search for Multiple Targets	2021	VLDB	5.7242766e-05
7,357	Crowdsourced Data Management: Overview and Challenges	2017	SIGMOD	5.6346837e-05
7,665	Towards Globally Optimal Crowdsourcing Quality Management: The Uniform Worker Setting	2016	SIGMOD	5.5718685e-05
7,729	Subjective Knowledge Base Construction Powered By Crowdsourcing and Knowledge Base	2018	SIGMOD	5.5574654e-05
8,592	Robust Entity Resolution using Random Graphs	2018	SIGMOD	5.4058393e-05
9,401	CDB: Optimizing Queries with Crowd-Based Selections and Joins	2017	SIGMOD	5.2755515e-05
9,818	Hierarchical Entity Resolution using an Oracle	2022	SIGMOD	5.214913e-05
9,820	How to Design Robust Algorithms using Noisy Comparison Oracle	2021	VLDB	5.214913e-05
9,992	Progressive Entity Matching: A Design Space Exploration	2025	SIGMOD	5.1815618e-05
10,049	Towards Interpretable and Learnable Risk Analysis for Entity Resolution	2020	SIGMOD	5.1685424e-05
10,318	In-context Clustering-based Entity Resolution with Large Language Models: A Design Space Exploration	2026	SIGMOD	5.093636e-05
10,382	LLM-Powered Interactive Graph Search: A Scalable and Practical Approach	2026	SIGMOD	5.093636e-05
10,878	Evaluating Methods for Efficient Entity Count Estimation	2025	VLDB	5.093636e-05
11,641	Approximation Algorithms for Large Scale Data Analysis	2021	PODS	5.093636e-05
11,936	A Demonstration of PERC: Probabilistic Entity Resolution With Crowd Errors	2018	VLDB	5.093636e-05
11,995	CrowdDQS: Dynamic Question Selection in Crowdsourcing Systems	2017	SIGMOD	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 5 of 5 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
196	CrowdER: Crowdsourcing Entity Resolution	2012	VLDB	0.00025780596
265	Human-powered Sorts and Joins	2012	VLDB	0.00022935368
852	Leveraging Transitive Relations for Crowdsourced Joins	2013	SIGMOD	0.00013604253
933	Question Selection for Crowd Entity Resolution	2013	VLDB	0.00013111293
4,428	Arnold: Declarative Crowd-Machine Data Integration	2013	CIDR	6.7094035e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	5,474	CrowdQ: Crowdsourced Query Understanding	2013	CIDR
2	3,496	Waldo: An Adaptive Human Interface for Crowd Entity Resolution	2017	SIGMOD
3	3,231	Truth Inference in Crowdsourcing: Is the Problem Solved?	2017	VLDB
4	852	Leveraging Transitive Relations for Crowdsourced Joins	2013	SIGMOD
5	7,493	Human-in-the-loop Data Integration	2017	VLDB
6	11,936	A Demonstration of PERC: Probabilistic Entity Resolution With Crowd Errors	2018	VLDB
7	4,538	Cost-Effective Crowdsourced Entity Resolution: A Partial-Order Approach	2016	SIGMOD
8	196	CrowdER: Crowdsourcing Entity Resolution	2012	VLDB
9	8,592	Robust Entity Resolution using Random Graphs	2018	SIGMOD
10	933	Question Selection for Crowd Entity Resolution	2013	VLDB