iCrowd: An Adaptive Crowdsourcing Framework

Summary: iCrowd adapts crowdsourcing via online, task-specific accuracy estimation and assigns tasks to the best-matching online worker. Post-submission updates refine accuracies for better future allocations; MTurk experiments show higher quality than qualification-based baselines. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h0e2789eed876a78d
Venue: SIGMOD
Year: 2015
Pagerank: 7.5455503e-05
Overall Rank: 3,197 | 78.51%
DOI: 10.1145/2723372.2750550

Incoming Non-self Citations Over Time

Authors

1. Ju Fan (National University of Singapore)
2. Guoliang Li (Tsinghua University)
3. Beng Chin Ooi (National University of Singapore)
4. Kian-lee Tan (National University of Singapore)
5. Jianhua Feng (Tsinghua University)

BibTeX Citation

@inproceedings{fan_sigmod15,
        title = {{iCrowd: An Adaptive Crowdsourcing Framework}},
        author = {Fan, Ju and Li, Guoliang and Ooi, Beng Chin and Tan, Kian-lee and Feng, Jianhua},
        series = {{SIGMOD} '15},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/2723372.2750550},
        url = {https://dl.acm.org/doi/10.1145/2723372.2750550},
        year = {2015}
}

Incoming Citations (Sorted by Pagerank)

Showing 23 of 23 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
3,171	Truth Inference in Crowdsourcing: Is the Problem Solved?	2017	VLDB	7.5691557e-05
3,307	Cleaning Crowdsourced Labels Using Oracles for Statistical Classification	2019	VLDB	7.4414303e-05
4,623	Cost-Effective Crowdsourced Entity Resolution: A Partial-Order Approach	2016	SIGMOD	6.4978811e-05
4,917	Crowdsourced Top-k Queries by Confidence-Aware Pairwise Judgments	2017	SIGMOD	6.3553844e-05
5,570	Efficient Algorithms for Crowd-Aided Categorization	2020	VLDB	6.0811968e-05
5,814	Domain Adaptation for Deep Entity Resolution	2022	SIGMOD	5.9852808e-05
6,233	Fine-grained Concept Linking using Neural Networks in Healthcare	2018	SIGMOD	5.8420918e-05
6,397	Human-in-the-loop Data Integration	2017	VLDB	5.7989499e-05
6,428	Domain-Aware Multi-Truth Discovery from Conflicting Sources	2018	VLDB	5.7886234e-05
6,925	Interactive Graph Search	2019	SIGMOD	5.6423723e-05
7,042	Human-in-the-loop Outlier Detection	2020	SIGMOD	5.6142998e-05
7,052	Cost-Effective Data Annotation using Game-Based Crowdsourcing	2019	VLDB	5.6127577e-05
7,500	Crowdsourced Data Management: Overview and Challenges	2017	SIGMOD	5.5083793e-05
7,884	Subjective Knowledge Base Construction Powered By Crowdsourcing and Knowledge Base	2018	SIGMOD	5.4335791e-05
8,664	CrowdGame: A Game-Based Crowdsourcing System for Cost-Effective Data Labeling	2019	SIGMOD	5.2926663e-05
9,191	Interactive Graph Search for Multiple Targets on DAGs	2025	VLDB	5.2110714e-05
9,583	CDB: Optimizing Queries with Crowd-Based Selections and Joins	2017	SIGMOD	5.1571823e-05
9,618	SubTab: Data Exploration with Informative Sub-Tables	2022	SIGMOD	5.1505136e-05
10,037	CrowdDQS: Dynamic Question Selection in Crowdsourcing Systems	2017	SIGMOD	5.0925155e-05
10,850	Noisy Interactive Graph Search: An Uncertainty-Based Approach with Online Modeling of Latent Expertise and Difficulty	2026	VLDB	4.9793485e-05
12,212	A Rating-Ranking Method for Crowdsourced Top-k Computation	2018	SIGMOD	4.9793485e-05
12,314	DOCS: Domain-Aware Crowdsourcing System	2017	VLDB	4.9793485e-05
12,358	December: A Declarative Tool for Crowd Member Selection	2016	VLDB	4.9793485e-05

Outgoing Citations (Sorted by Pagerank)

Showing 14 of 14 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
92	CrowdDB: Answering Queries with Crowdsourcing	2011	SIGMOD	0.00034672523
198	CrowdER: Crowdsourcing Entity Resolution	2012	VLDB	0.00025555196
257	Crowdsourced Databases: Query Processing with People	2011	CIDR	0.00022962347
259	Answering Queries using Humans, Algorithms and Databases	2011	CIDR	0.00022923243
266	Human-powered Sorts and Joins	2012	VLDB	0.00022739124
749	So Who Won? Dynamic Max Discovery with the Crowd	2012	SIGMOD	0.00014265279
787	Human-Assisted Graph Search: It’s Okay to Ask Questions	2011	VLDB	0.00013988274
987	CrowdScreen: Algorithms for Filtering Data with Humans	2012	SIGMOD	0.00012660627
1,247	Entity Matching: How Similar Is Similar	2011	VLDB	0.00011346515
1,264	CDAS: A Crowdsourcing Data Analytics System	2012	VLDB	0.0001128316
1,851	CrowdDB: Query Processing with the VLDB Crowd	2011	VLDB	9.5037355e-05
2,653	CrowdFill: Collecting Structured Data from the Crowd	2014	SIGMOD	8.1732164e-05
3,838	Optimal Crowd-Powered Rating and Filtering Algorithms	2014	VLDB	6.9929907e-05
4,220	Whom to Ask? Jury Selection for Decision Making Tasks on Micro-blog Services	2012	VLDB	6.7252203e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	5,250	An Online Cost Sensitive Decision-Making Method in Crowdsourcing Systems	2013	SIGMOD
2	12,224	Crowdsourcing Analytics with CrowdCur	2018	SIGMOD
3	1,264	CDAS: A Crowdsourcing Data Analytics System	2012	VLDB
4	5,024	Crowdsourced Top-k Algorithms: An Experimental Evaluation	2016	VLDB
5	7,371	Hear the Whole Story: Towards the Diversity of Opinion in Crowdsourcing Markets	2015	VLDB
6	8,518	Minimizing Efforts in Validating Crowd Answers	2015	SIGMOD
7	12,394	The Importance of Being Expert: Efficient Max-Finding in Crowdsourcing	2015	SIGMOD
8	12,361	Collaborative Crowdsourcing with Crowd4U	2016	VLDB
9	3,839	QASCA: A Quality-Aware Task Assignment System for Crowdsourcing Applications	2015	SIGMOD
10	10,037	CrowdDQS: Dynamic Question Selection in Crowdsourcing Systems	2017	SIGMOD