Waldo: An Adaptive Human Interface for Crowd Entity Resolution

Summary: Waldo presents an adaptive hybrid UI for crowd-based ER, merging two common human-task interfaces. Formalizes the human-task selection problem, offers optimality-guaranteed algorithms, and reports 50–300% crowd-cost reductions versus baselines. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 5359
Venue: SIGMOD
Year: 2017
Pagerank: 7.3634471e-05
Overall Rank: 3,496 | 76.02%
DOI: 10.1145/3035918.3035931

Incoming Non-self Citations Over Time

Authors

1. Vasilis Verroios (Stanford University)
2. Hector Garcia-Molina (Stanford University)
3. Yannis Papakonstantinou (University of California San Diego)

BibTeX Citation

@inproceedings{verroios_sigmod17,
        title = {{Waldo: An Adaptive Human Interface for Crowd Entity Resolution}},
        author = {Verroios, Vasilis and Garcia-Molina, Hector and Papakonstantinou, Yannis},
        series = {{SIGMOD} '17},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3035918.3035931},
        url = {https://dl.acm.org/doi/10.1145/3035918.3035931},
        year = {2017}
}

Incoming Citations (Sorted by Pagerank)

Showing 12 of 12 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
2,463	A Comprehensive Benchmark Framework for Active Learning Methods in Entity Matching	2020	SIGMOD	8.5486912e-05
4,100	Data Integration and Machine Learning: A Natural Synergy	2018	SIGMOD	6.9016092e-05
4,824	Deep Indexed Active Learning for Matching Heterogeneous Entity Representations	2022	VLDB	6.4914944e-05
6,908	Cost-Effective Data Annotation using Game-Based Crowdsourcing	2019	VLDB	5.7415834e-05
7,313	Interactive Graph Search	2019	SIGMOD	5.6480084e-05
7,424	Data Integration and Machine Learning: A Natural Synergy	2018	VLDB	5.6214566e-05
8,225	Deducing Certain Fixes to Graphs	2019	VLDB	5.4624971e-05
8,592	Robust Entity Resolution using Random Graphs	2018	SIGMOD	5.4058393e-05
9,812	Interactive Graph Search for Multiple Targets on DAGs	2025	VLDB	5.214913e-05
9,818	Hierarchical Entity Resolution using an Oracle	2022	SIGMOD	5.214913e-05
10,049	Towards Interpretable and Learnable Risk Analysis for Entity Resolution	2020	SIGMOD	5.1685424e-05
10,382	LLM-Powered Interactive Graph Search: A Scalable and Practical Approach	2026	SIGMOD	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 17 of 17 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
196	CrowdER: Crowdsourcing Entity Resolution	2012	VLDB	0.00025780596
265	Human-powered Sorts and Joins	2012	VLDB	0.00022935368
439	Corleone: Hands-Off Crowdsourcing for Entity Matching	2014	SIGMOD	0.00018464913
528	On Active Learning of Record Matching Packages	2010	SIGMOD	0.00017100838
852	Leveraging Transitive Relations for Crowdsourced Joins	2013	SIGMOD	0.00013604253
933	Question Selection for Crowd Entity Resolution	2013	VLDB	0.00013111293
1,101	KATARA: A Data Cleaning System Powered by Knowledge Bases and Crowdsourcing	2015	SIGMOD	0.00012168934
1,443	Crowdsourcing Algorithms for Entity Resolution	2014	VLDB	0.00010773106
2,570	Query-Oriented Data Cleaning with Oracles	2015	SIGMOD	8.4061164e-05
2,711	Progressive Approach to Relational Entity Resolution	2014	VLDB	8.2178865e-05
3,235	Large-Scale Collective Entity Matching	2011	VLDB	7.6139368e-05
3,602	Online Entity Resolution Using an Oracle	2016	VLDB	7.2691521e-05
3,916	Incremental Record Linkage	2014	VLDB	7.0185679e-05
3,971	CLAMShell: Speeding up Crowds for Low-latency Data Labeling	2016	VLDB	6.9835263e-05
3,983	Crowd-Based Deduplication: An Adaptive Approach	2015	SIGMOD	6.9739851e-05
4,539	Reducing Uncertainty of Schema Matching via Crowdsourcing	2013	VLDB	6.6403822e-05
10,031	tDP: An Optimal-Latency Budget Allocation Strategy for Crowdsourced MAXIMUM Operations	2015	SIGMOD	5.1741314e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	248	Evaluation of entity resolution approaches on real-world match problems	2010	VLDB
2	5,474	CrowdQ: Crowdsourced Query Understanding	2013	CIDR
3	5,830	Exploiting Context Analysis for Combining Multiple Entity Resolution Systems	2009	SIGMOD
4	11,936	A Demonstration of PERC: Probabilistic Entity Resolution With Crowd Errors	2018	VLDB
5	7,493	Human-in-the-loop Data Integration	2017	VLDB
6	8,592	Robust Entity Resolution using Random Graphs	2018	SIGMOD
7	4,538	Cost-Effective Crowdsourced Entity Resolution: A Partial-Order Approach	2016	SIGMOD
8	933	Question Selection for Crowd Entity Resolution	2013	VLDB
9	1,443	Crowdsourcing Algorithms for Entity Resolution	2014	VLDB
10	196	CrowdER: Crowdsourcing Entity Resolution	2012	VLDB