So Who Won? Dynamic Max Discovery with the Crowd

Summary: Dynamic max discovery in a crowdsourcing DB relies on human pairwise judgments under latency and cost. Optimal max selection and extra-vote gathering are NP-hard; the paper offers heuristics for max-finding and vote acquisition with experiments. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: hb61a834e838350f2
Venue: SIGMOD
Year: 2012
Pagerank: 0.00014258988
Overall Rank: 750 | 94.97%
DOI: 10.1145/2213836.2213880

Incoming Non-self Citations Over Time

Authors

1. Stephen Guo (Stanford University)
2. Aditya Parameswaran (Stanford University)
3. Hector Garcia-Molina (Stanford University)

BibTeX Citation

@inproceedings{guo_sigmod12,
        title = {{So Who Won? Dynamic Max Discovery with the Crowd}},
        author = {Guo, Stephen and Parameswaran, Aditya and Garcia-Molina, Hector},
        series = {{SIGMOD} '12},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/2213836.2213880},
        url = {https://dl.acm.org/doi/10.1145/2213836.2213880},
        year = {2012}
}

Incoming Citations (Sorted by Pagerank)

Showing 36 of 36 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
433	Corleone: Hands-Off Crowdsourcing for Entity Matching	2014	SIGMOD	0.00018324965
871	Leveraging Transitive Relations for Crowdsourced Joins	2013	SIGMOD	0.00013338722
1,655	Falcon: Scaling Up Hands-Off Crowdsourced Entity Matching to Build Cloud Services	2017	SIGMOD	9.9694129e-05
1,926	Counting with the Crowd	2013	VLDB	9.3636304e-05
3,173	Truth Inference in Crowdsourcing: Is the Problem Solved?	2017	VLDB	7.5655739e-05
3,199	iCrowd: An Adaptive Crowdsourcing Framework	2015	SIGMOD	7.5419863e-05
3,372	Finish Them!: Pricing Algorithms for Human Computation	2014	VLDB	7.3658309e-05
3,668	Revisiting Prompt Engineering via Declarative Crowdsourcing	2024	CIDR	7.1144218e-05
3,839	Optimal Crowd-Powered Rating and Filtering Algorithms	2014	VLDB	6.9896853e-05
3,840	QASCA: A Quality-Aware Task Assignment System for Crowdsourcing Applications	2015	SIGMOD	6.988858e-05
4,053	Crowd-Based Deduplication: An Adaptive Approach	2015	SIGMOD	6.8253348e-05
4,482	Top-k Sorting Under Partial Order Information	2018	SIGMOD	6.5783263e-05
4,519	Arnold: Declarative Crowd-Machine Data Integration	2013	CIDR	6.5602428e-05
4,625	Cost-Effective Crowdsourced Entity Resolution: A Partial-Order Approach	2016	SIGMOD	6.4948389e-05
4,918	Crowdsourced Top-k Queries by Confidence-Aware Pairwise Judgments	2017	SIGMOD	6.3523802e-05
5,027	Crowdsourced Top-k Algorithms: An Experimental Evaluation	2016	VLDB	6.3066319e-05
5,253	An Online Cost Sensitive Decision-Making Method in Crowdsourcing Systems	2013	SIGMOD	6.206776e-05
6,400	Human-in-the-loop Data Integration	2017	VLDB	5.7962311e-05
6,928	Interactive Graph Search	2019	SIGMOD	5.6397012e-05
7,091	Answering Planning Queries with the Crowd	2013	VLDB	5.5991673e-05
7,230	OASSIS: Query Driven Crowd Mining	2014	SIGMOD	5.5779439e-05
7,377	Hear the Whole Story: Towards the Diversity of Opinion in Crowdsourcing Markets	2015	VLDB	5.5381227e-05
7,505	Crowdsourced Data Management: Overview and Challenges	2017	SIGMOD	5.5057737e-05
8,144	Where To: Crowd-Aided Path Selection	2014	VLDB	5.3898812e-05
8,963	Understanding Workers, Developing Effective Tasks, and Enhancing Marketplace Dynamics: A Study of a Large Crowdsourcing Marketplace	2017	VLDB	5.2486059e-05
9,200	Interactive Graph Search for Multiple Targets on DAGs	2025	VLDB	5.2086045e-05
9,591	CDB: Optimizing Queries with Crowd-Based Selections and Joins	2017	SIGMOD	5.154741e-05
10,011	Hierarchical Entity Resolution using an Oracle	2022	SIGMOD	5.0954911e-05
10,013	How to Design Robust Algorithms using Noisy Comparison Oracle	2021	VLDB	5.0954911e-05
10,225	Skyline Queries with Noisy Comparisons	2015	PODS	5.0556452e-05
10,226	tDP: An Optimal-Latency Budget Allocation Strategy for Crowdsourced MAXIMUM Operations	2015	SIGMOD	5.0556452e-05
10,227	gMission: A General Spatial Crowdsourcing Platform	2014	VLDB	5.0556452e-05
10,859	Noisy Interactive Graph Search: An Uncertainty-Based Approach with Online Modeling of Latent Expertise and Difficulty	2026	VLDB	4.9769913e-05
11,497	k-Clustering with Comparison and Distance Oracles	2024	PODS	4.9769913e-05
12,218	A Rating-Ranking Method for Crowdsourced Top-k Computation	2018	SIGMOD	4.9769913e-05
12,400	The Importance of Being Expert: Efficient Max-Finding in Crowdsourcing	2015	SIGMOD	4.9769913e-05

Outgoing Citations (Sorted by Pagerank)

Showing 3 of 3 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
92	CrowdDB: Answering Queries with Crowdsourcing	2011	SIGMOD	0.00034670735
266	Human-powered Sorts and Joins	2012	VLDB	0.00022735106
787	Human-Assisted Graph Search: It’s Okay to Ask Questions	2011	VLDB	0.00013982951

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	5,572	Efficient Algorithms for Crowd-Aided Categorization	2020	VLDB
2	4,220	Whom to Ask? Jury Selection for Decision Making Tasks on Micro-blog Services	2012	VLDB
3	9,591	CDB: Optimizing Queries with Crowd-Based Selections and Joins	2017	SIGMOD
4	92	CrowdDB: Answering Queries with Crowdsourcing	2011	SIGMOD
5	8,918	Reliable Diversity-Based Spatial Crowdsourcing by Moving Workers	2015	VLDB
6	10,226	tDP: An Optimal-Latency Budget Allocation Strategy for Crowdsourced MAXIMUM Operations	2015	SIGMOD
7	7,091	Answering Planning Queries with the Crowd	2013	VLDB
8	5,027	Crowdsourced Top-k Algorithms: An Experimental Evaluation	2016	VLDB
9	987	CrowdScreen: Algorithms for Filtering Data with Humans	2012	SIGMOD
10	12,400	The Importance of Being Expert: Efficient Max-Finding in Crowdsourcing	2015	SIGMOD