CrowdDQS: Dynamic Question Selection in Crowdsourcing Systems

Summary: Batch-posts all questions; last-moment assignment concentrates votes on uncertain items. Real-time accuracy estimates with/without gold questions, infers skill distributions; AMT deployment with 1000+ workers yields up to 6× fewer votes, with deployment challenges discussed. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 5493
Venue: SIGMOD
Year: 2017
Pagerank: 5.093636e-05
Overall Rank: 11,995 | 17.71%
DOI: 10.1145/3035918.3064055

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

1. Asif R. Khan (Stanford University)
2. Hector Garcia-Molina (Stanford University)

BibTeX Citation

@inproceedings{khan_sigmod17,
        title = {{CrowdDQS: Dynamic Question Selection in Crowdsourcing Systems}},
        author = {Khan, Asif R. and Garcia-Molina, Hector},
        series = {{SIGMOD} '17},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3035918.3064055},
        url = {https://dl.acm.org/doi/10.1145/3035918.3064055},
        year = {2017}
}

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank

Outgoing Citations (Sorted by Pagerank)

Showing 9 of 9 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
196	CrowdER: Crowdsourcing Entity Resolution	2012	VLDB	0.00025780596
265	Human-powered Sorts and Joins	2012	VLDB	0.00022935368
997	CrowdScreen: Algorithms for Filtering Data with Humans	2012	SIGMOD	0.00012755983
1,270	CDAS: A Crowdsourcing Data Analytics System	2012	VLDB	0.00011388453
1,443	Crowdsourcing Algorithms for Entity Resolution	2014	VLDB	0.00010773106
3,262	iCrowd: An Adaptive Crowdsourcing Framework	2015	SIGMOD	7.5846052e-05
3,904	QASCA: A Quality-Aware Task Assignment System for Crowdsourcing Applications	2015	SIGMOD	7.0304212e-05
4,153	Whom to Ask? Jury Selection for Decision Making Tasks on Micro-blog Services	2012	VLDB	6.8676997e-05
10,031	tDP: An Optimal-Latency Budget Allocation Strategy for Crowdsourced MAXIMUM Operations	2015	SIGMOD	5.1741314e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	11,956	Worker Recommendation for Crowdsourced Q&A Services: A Triple-Factor Aware Approach	2018	VLDB
2	251	Crowdsourced Databases: Query Processing with People	2011	CIDR
3	11,788	Recommending Deployment Strategies for Collaborative Tasks	2020	SIGMOD
4	7,665	Towards Globally Optimal Crowdsourcing Quality Management: The Uniform Worker Setting	2016	SIGMOD
5	12,019	DOCS: Domain-Aware Crowdsourcing System	2017	VLDB
6	90	CrowdDB: Answering Queries with Crowdsourcing	2011	SIGMOD
7	8,351	Minimizing Efforts in Validating Crowd Answers	2015	SIGMOD
8	5,143	An Online Cost Sensitive Decision-Making Method in Crowdsourcing Systems	2013	SIGMOD
9	3,904	QASCA: A Quality-Aware Task Assignment System for Crowdsourcing Applications	2015	SIGMOD
10	3,262	iCrowd: An Adaptive Crowdsourcing Framework	2015	SIGMOD