iCrowd: An Adaptive Crowdsourcing Framework

Summary: iCrowd adapts crowdsourcing via online, task-specific accuracy estimation and assigns tasks to the best-matching online worker. Post-submission updates refine accuracies for better future allocations; MTurk experiments show higher quality than qualification-based baselines. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h0e2789eed876a78d
Venue: SIGMOD
Year: 2015
Pagerank: 7.5419863e-05
Overall Rank: 3,199 | 78.51%
DOI: 10.1145/2723372.2750550

Incoming Non-self Citations Over Time

Authors

1. Ju Fan (National University of Singapore)
2. Guoliang Li (Tsinghua University)
3. Beng Chin Ooi (National University of Singapore)
4. Kian-lee Tan (National University of Singapore)
5. Jianhua Feng (Tsinghua University)

BibTeX Citation

@inproceedings{fan_sigmod15,
        title = {{iCrowd: An Adaptive Crowdsourcing Framework}},
        author = {Fan, Ju and Li, Guoliang and Ooi, Beng Chin and Tan, Kian-lee and Feng, Jianhua},
        series = {{SIGMOD} '15},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/2723372.2750550},
        url = {https://dl.acm.org/doi/10.1145/2723372.2750550},
        year = {2015}
}

Incoming Citations (Sorted by Pagerank)

Showing 23 of 23 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
3,173	Truth Inference in Crowdsourcing: Is the Problem Solved?	2017	VLDB	7.5655739e-05
3,308	Cleaning Crowdsourced Labels Using Oracles for Statistical Classification	2019	VLDB	7.4379101e-05
4,625	Cost-Effective Crowdsourced Entity Resolution: A Partial-Order Approach	2016	SIGMOD	6.4948389e-05
4,918	Crowdsourced Top-k Queries by Confidence-Aware Pairwise Judgments	2017	SIGMOD	6.3523802e-05
5,572	Efficient Algorithms for Crowd-Aided Categorization	2020	VLDB	6.078318e-05
5,815	Domain Adaptation for Deep Entity Resolution	2022	SIGMOD	5.9824897e-05
6,236	Fine-grained Concept Linking using Neural Networks in Healthcare	2018	SIGMOD	5.83935e-05
6,400	Human-in-the-loop Data Integration	2017	VLDB	5.7962311e-05
6,431	Domain-Aware Multi-Truth Discovery from Conflicting Sources	2018	VLDB	5.7858831e-05
6,928	Interactive Graph Search	2019	SIGMOD	5.6397012e-05
7,043	Human-in-the-loop Outlier Detection	2020	SIGMOD	5.611642e-05
7,054	Cost-Effective Data Annotation using Game-Based Crowdsourcing	2019	VLDB	5.6101007e-05
7,505	Crowdsourced Data Management: Overview and Challenges	2017	SIGMOD	5.5057737e-05
7,889	Subjective Knowledge Base Construction Powered By Crowdsourcing and Knowledge Base	2018	SIGMOD	5.4312213e-05
8,672	CrowdGame: A Game-Based Crowdsourcing System for Cost-Effective Data Labeling	2019	SIGMOD	5.2901608e-05
9,200	Interactive Graph Search for Multiple Targets on DAGs	2025	VLDB	5.2086045e-05
9,591	CDB: Optimizing Queries with Crowd-Based Selections and Joins	2017	SIGMOD	5.154741e-05
9,625	SubTab: Data Exploration with Informative Sub-Tables	2022	SIGMOD	5.1480754e-05
10,042	CrowdDQS: Dynamic Question Selection in Crowdsourcing Systems	2017	SIGMOD	5.0901047e-05
10,859	Noisy Interactive Graph Search: An Uncertainty-Based Approach with Online Modeling of Latent Expertise and Difficulty	2026	VLDB	4.9769913e-05
12,218	A Rating-Ranking Method for Crowdsourced Top-k Computation	2018	SIGMOD	4.9769913e-05
12,320	DOCS: Domain-Aware Crowdsourcing System	2017	VLDB	4.9769913e-05
12,364	December: A Declarative Tool for Crowd Member Selection	2016	VLDB	4.9769913e-05

Outgoing Citations (Sorted by Pagerank)

Showing 14 of 14 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
92	CrowdDB: Answering Queries with Crowdsourcing	2011	SIGMOD	0.00034670735
198	CrowdER: Crowdsourcing Entity Resolution	2012	VLDB	0.00025546182
257	Crowdsourced Databases: Query Processing with People	2011	CIDR	0.00022958404
259	Answering Queries using Humans, Algorithms and Databases	2011	CIDR	0.00022916014
266	Human-powered Sorts and Joins	2012	VLDB	0.00022735106
750	So Who Won? Dynamic Max Discovery with the Crowd	2012	SIGMOD	0.00014258988
787	Human-Assisted Graph Search: It’s Okay to Ask Questions	2011	VLDB	0.00013982951
987	CrowdScreen: Algorithms for Filtering Data with Humans	2012	SIGMOD	0.00012655094
1,249	Entity Matching: How Similar Is Similar	2011	VLDB	0.00011342019
1,265	CDAS: A Crowdsourcing Data Analytics System	2012	VLDB	0.00011277921
1,852	CrowdDB: Query Processing with the VLDB Crowd	2011	VLDB	9.4992704e-05
2,653	CrowdFill: Collecting Structured Data from the Crowd	2014	SIGMOD	8.1693619e-05
3,839	Optimal Crowd-Powered Rating and Filtering Algorithms	2014	VLDB	6.9896853e-05
4,220	Whom to Ask? Jury Selection for Decision Making Tasks on Micro-blog Services	2012	VLDB	6.7220383e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	92	CrowdDB: Answering Queries with Crowdsourcing	2011	SIGMOD
2	12,230	Crowdsourcing Analytics with CrowdCur	2018	SIGMOD
3	1,265	CDAS: A Crowdsourcing Data Analytics System	2012	VLDB
4	5,027	Crowdsourced Top-k Algorithms: An Experimental Evaluation	2016	VLDB
5	7,377	Hear the Whole Story: Towards the Diversity of Opinion in Crowdsourcing Markets	2015	VLDB
6	8,524	Minimizing Efforts in Validating Crowd Answers	2015	SIGMOD
7	12,400	The Importance of Being Expert: Efficient Max-Finding in Crowdsourcing	2015	SIGMOD
8	12,367	Collaborative Crowdsourcing with Crowd4U	2016	VLDB
9	3,840	QASCA: A Quality-Aware Task Assignment System for Crowdsourcing Applications	2015	SIGMOD
10	10,042	CrowdDQS: Dynamic Question Selection in Crowdsourcing Systems	2017	SIGMOD