So Who Won? Dynamic Max Discovery with the Crowd

Summary: Dynamic max discovery in a crowdsourcing DB relies on human pairwise judgments under latency and cost. Optimal max selection and extra-vote gathering are NP-hard; the paper offers heuristics for max-finding and vote acquisition with experiments. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: hb61a834e838350f2
Venue: SIGMOD
Year: 2012
Pagerank: 0.00014265279
Overall Rank: 749 | 94.97%
DOI: 10.1145/2213836.2213880

Incoming Non-self Citations Over Time

Authors

1. Stephen Guo (Stanford University)
2. Aditya Parameswaran (Stanford University)
3. Hector Garcia-Molina (Stanford University)

BibTeX Citation

@inproceedings{guo_sigmod12,
        title = {{So Who Won? Dynamic Max Discovery with the Crowd}},
        author = {Guo, Stephen and Parameswaran, Aditya and Garcia-Molina, Hector},
        series = {{SIGMOD} '12},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/2213836.2213880},
        url = {https://dl.acm.org/doi/10.1145/2213836.2213880},
        year = {2012}
}

Incoming Citations (Sorted by Pagerank)

Showing 36 of 36 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
433	Corleone: Hands-Off Crowdsourcing for Entity Matching	2014	SIGMOD	0.00018332741
871	Leveraging Transitive Relations for Crowdsourced Joins	2013	SIGMOD	0.00013343705
1,654	Falcon: Scaling Up Hands-Off Crowdsourced Entity Matching to Build Cloud Services	2017	SIGMOD	9.9739611e-05
1,926	Counting with the Crowd	2013	VLDB	9.3637786e-05
3,171	Truth Inference in Crowdsourcing: Is the Problem Solved?	2017	VLDB	7.5691557e-05
3,197	iCrowd: An Adaptive Crowdsourcing Framework	2015	SIGMOD	7.5455503e-05
3,372	Finish Them!: Pricing Algorithms for Human Computation	2014	VLDB	7.3693102e-05
3,695	Revisiting Prompt Engineering via Declarative Crowdsourcing	2024	CIDR	7.092445e-05
3,838	Optimal Crowd-Powered Rating and Filtering Algorithms	2014	VLDB	6.9929907e-05
3,839	QASCA: A Quality-Aware Task Assignment System for Crowdsourcing Applications	2015	SIGMOD	6.9921604e-05
4,051	Crowd-Based Deduplication: An Adaptive Approach	2015	SIGMOD	6.8285415e-05
4,478	Top-k Sorting Under Partial Order Information	2018	SIGMOD	6.5814419e-05
4,518	Arnold: Declarative Crowd-Machine Data Integration	2013	CIDR	6.5632796e-05
4,623	Cost-Effective Crowdsourced Entity Resolution: A Partial-Order Approach	2016	SIGMOD	6.4978811e-05
4,917	Crowdsourced Top-k Queries by Confidence-Aware Pairwise Judgments	2017	SIGMOD	6.3553844e-05
5,024	Crowdsourced Top-k Algorithms: An Experimental Evaluation	2016	VLDB	6.3096186e-05
5,250	An Online Cost Sensitive Decision-Making Method in Crowdsourcing Systems	2013	SIGMOD	6.2097153e-05
6,397	Human-in-the-loop Data Integration	2017	VLDB	5.7989499e-05
6,925	Interactive Graph Search	2019	SIGMOD	5.6423723e-05
7,089	Answering Planning Queries with the Crowd	2013	VLDB	5.6018191e-05
7,228	OASSIS: Query Driven Crowd Mining	2014	SIGMOD	5.5805857e-05
7,371	Hear the Whole Story: Towards the Diversity of Opinion in Crowdsourcing Markets	2015	VLDB	5.5407456e-05
7,500	Crowdsourced Data Management: Overview and Challenges	2017	SIGMOD	5.5083793e-05
8,137	Where To: Crowd-Aided Path Selection	2014	VLDB	5.3924339e-05
8,955	Understanding Workers, Developing Effective Tasks, and Enhancing Marketplace Dynamics: A Study of a Large Crowdsourcing Marketplace	2017	VLDB	5.2510657e-05
9,191	Interactive Graph Search for Multiple Targets on DAGs	2025	VLDB	5.2110714e-05
9,583	CDB: Optimizing Queries with Crowd-Based Selections and Joins	2017	SIGMOD	5.1571823e-05
10,006	Hierarchical Entity Resolution using an Oracle	2022	SIGMOD	5.0979044e-05
10,008	How to Design Robust Algorithms using Noisy Comparison Oracle	2021	VLDB	5.0979044e-05
10,219	Skyline Queries with Noisy Comparisons	2015	PODS	5.0580396e-05
10,220	tDP: An Optimal-Latency Budget Allocation Strategy for Crowdsourced MAXIMUM Operations	2015	SIGMOD	5.0580396e-05
10,221	gMission: A General Spatial Crowdsourcing Platform	2014	VLDB	5.0580396e-05
10,850	Noisy Interactive Graph Search: An Uncertainty-Based Approach with Online Modeling of Latent Expertise and Difficulty	2026	VLDB	4.9793485e-05
11,491	k-Clustering with Comparison and Distance Oracles	2024	PODS	4.9793485e-05
12,212	A Rating-Ranking Method for Crowdsourced Top-k Computation	2018	SIGMOD	4.9793485e-05
12,394	The Importance of Being Expert: Efficient Max-Finding in Crowdsourcing	2015	SIGMOD	4.9793485e-05

Outgoing Citations (Sorted by Pagerank)

Showing 3 of 3 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
92	CrowdDB: Answering Queries with Crowdsourcing	2011	SIGMOD	0.00034672523
266	Human-powered Sorts and Joins	2012	VLDB	0.00022739124
787	Human-Assisted Graph Search: It’s Okay to Ask Questions	2011	VLDB	0.00013988274

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	5,250	An Online Cost Sensitive Decision-Making Method in Crowdsourcing Systems	2013	SIGMOD
2	4,220	Whom to Ask? Jury Selection for Decision Making Tasks on Micro-blog Services	2012	VLDB
3	9,583	CDB: Optimizing Queries with Crowd-Based Selections and Joins	2017	SIGMOD
4	92	CrowdDB: Answering Queries with Crowdsourcing	2011	SIGMOD
5	8,910	Reliable Diversity-Based Spatial Crowdsourcing by Moving Workers	2015	VLDB
6	10,220	tDP: An Optimal-Latency Budget Allocation Strategy for Crowdsourced MAXIMUM Operations	2015	SIGMOD
7	7,089	Answering Planning Queries with the Crowd	2013	VLDB
8	5,024	Crowdsourced Top-k Algorithms: An Experimental Evaluation	2016	VLDB
9	987	CrowdScreen: Algorithms for Filtering Data with Humans	2012	SIGMOD
10	12,394	The Importance of Being Expert: Efficient Max-Finding in Crowdsourcing	2015	SIGMOD