iCrowd: An Adaptive Crowdsourcing Framework

Summary: iCrowd adapts crowdsourcing via online, task-specific accuracy estimation and assigns tasks to the best-matching online worker. Post-submission updates refine accuracies for better future allocations; MTurk experiments show higher quality than qualification-based baselines. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 5144
Venue: SIGMOD
Year: 2015
Pagerank: 7.5846052e-05
Overall Rank: 3,262 | 77.63%
DOI: 10.1145/2723372.2750550

Incoming Non-self Citations Over Time

Authors

1. Ju Fan (National University of Singapore)
2. Guoliang Li (Tsinghua University)
3. Beng Chin Ooi (National University of Singapore)
4. Kian-lee Tan (National University of Singapore)
5. Jianhua Feng (Tsinghua University)

BibTeX Citation

@inproceedings{fan_sigmod15,
        title = {{iCrowd: An Adaptive Crowdsourcing Framework}},
        author = {Fan, Ju and Li, Guoliang and Ooi, Beng Chin and Tan, Kian-lee and Feng, Jianhua},
        series = {{SIGMOD} '15},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/2723372.2750550},
        url = {https://dl.acm.org/doi/10.1145/2723372.2750550},
        year = {2015}
}

Incoming Citations (Sorted by Pagerank)

Showing 22 of 22 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
3,231	Truth Inference in Crowdsourcing: Is the Problem Solved?	2017	VLDB	7.6191767e-05
3,281	Cleaning Crowdsourced Labels Using Oracles for Statistical Classification	2019	VLDB	7.5706653e-05
4,538	Cost-Effective Crowdsourced Entity Resolution: A Partial-Order Approach	2016	SIGMOD	6.6404776e-05
4,821	Crowdsourced Top-k Queries by Confidence-Aware Pairwise Judgments	2017	SIGMOD	6.4935866e-05
5,730	Domain Adaptation for Deep Entity Resolution	2022	SIGMOD	6.1071585e-05
5,813	Efficient Algorithms for Crowd-Aided Categorization	2020	VLDB	6.0780519e-05
6,115	Fine-grained Concept Linking using Neural Networks in Healthcare	2018	SIGMOD	5.9709282e-05
6,787	Domain-Aware Multi-Truth Discovery from Conflicting Sources	2018	VLDB	5.7738798e-05
6,899	Human-in-the-loop Outlier Detection	2020	SIGMOD	5.7431609e-05
6,908	Cost-Effective Data Annotation using Game-Based Crowdsourcing	2019	VLDB	5.7415834e-05
7,313	Interactive Graph Search	2019	SIGMOD	5.6480084e-05
7,357	Crowdsourced Data Management: Overview and Challenges	2017	SIGMOD	5.6346837e-05
7,493	Human-in-the-loop Data Integration	2017	VLDB	5.6046905e-05
7,729	Subjective Knowledge Base Construction Powered By Crowdsourcing and Knowledge Base	2018	SIGMOD	5.5574654e-05
8,495	CrowdGame: A Game-Based Crowdsourcing System for Cost-Effective Data Labeling	2019	SIGMOD	5.4139128e-05
9,401	CDB: Optimizing Queries with Crowd-Based Selections and Joins	2017	SIGMOD	5.2755515e-05
9,438	SubTab: Data Exploration with Informative Sub-Tables	2022	SIGMOD	5.2687297e-05
9,812	Interactive Graph Search for Multiple Targets on DAGs	2025	VLDB	5.214913e-05
11,912	A Rating-Ranking Method for Crowdsourced Top-k Computation	2018	SIGMOD	5.093636e-05
11,995	CrowdDQS: Dynamic Question Selection in Crowdsourcing Systems	2017	SIGMOD	5.093636e-05
12,019	DOCS: Domain-Aware Crowdsourcing System	2017	VLDB	5.093636e-05
12,065	December: A Declarative Tool for Crowd Member Selection	2016	VLDB	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 14 of 14 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
90	CrowdDB: Answering Queries with Crowdsourcing	2011	SIGMOD	0.00034951786
196	CrowdER: Crowdsourcing Entity Resolution	2012	VLDB	0.00025780596
250	Answering Queries using Humans, Algorithms and Databases	2011	CIDR	0.00023261164
251	Crowdsourced Databases: Query Processing with People	2011	CIDR	0.00023261113
265	Human-powered Sorts and Joins	2012	VLDB	0.00022935368
743	So Who Won? Dynamic Max Discovery with the Crowd	2012	SIGMOD	0.00014421358
767	Human-Assisted Graph Search: It’s Okay to Ask Questions	2011	VLDB	0.00014208622
997	CrowdScreen: Algorithms for Filtering Data with Humans	2012	SIGMOD	0.00012755983
1,248	Entity Matching: How Similar Is Similar	2011	VLDB	0.00011498301
1,270	CDAS: A Crowdsourcing Data Analytics System	2012	VLDB	0.00011388453
1,810	CrowdDB: Query Processing with the VLDB Crowd	2011	VLDB	9.7021022e-05
2,636	CrowdFill: Collecting Structured Data from the Crowd	2014	SIGMOD	8.31868e-05
3,914	Optimal Crowd-Powered Rating and Filtering Algorithms	2014	VLDB	7.0204052e-05
4,153	Whom to Ask? Jury Selection for Decision Making Tasks on Micro-blog Services	2012	VLDB	6.8676997e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	90	CrowdDB: Answering Queries with Crowdsourcing	2011	SIGMOD
2	11,925	Crowdsourcing Analytics with CrowdCur	2018	SIGMOD
3	1,270	CDAS: A Crowdsourcing Data Analytics System	2012	VLDB
4	4,915	Crowdsourced Top-k Algorithms: An Experimental Evaluation	2016	VLDB
5	7,222	Hear the Whole Story: Towards the Diversity of Opinion in Crowdsourcing Markets	2015	VLDB
6	8,351	Minimizing Efforts in Validating Crowd Answers	2015	SIGMOD
7	12,101	The Importance of Being Expert: Efficient Max-Finding in Crowdsourcing	2015	SIGMOD
8	12,068	Collaborative Crowdsourcing with Crowd4U	2016	VLDB
9	3,904	QASCA: A Quality-Aware Task Assignment System for Crowdsourcing Applications	2015	SIGMOD
10	11,995	CrowdDQS: Dynamic Question Selection in Crowdsourcing Systems	2017	SIGMOD