iCrowd: An Adaptive Crowdsourcing Framework

Summary: iCrowd adapts crowdsourcing via online, task-specific accuracy estimation and assigns tasks to the best-matching online worker. Post-submission updates refine accuracies for better future allocations; MTurk experiments show higher quality than qualification-based baselines. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h0e2789eed876a78d
Venue: SIGMOD
Year: 2015
Pagerank: 7.5170875e-05
Overall Rank: 3,210 | 78.49%
DOI: 10.1145/2723372.2750550

Incoming Non-self Citations Over Time

Authors

1. Ju Fan (National University of Singapore)
2. Guoliang Li (Tsinghua University)
3. Beng Chin Ooi (National University of Singapore)
4. Kian-lee Tan (National University of Singapore)
5. Jianhua Feng (Tsinghua University)

BibTeX Citation

@inproceedings{fan_sigmod15,
        title = {{iCrowd: An Adaptive Crowdsourcing Framework}},
        author = {Fan, Ju and Li, Guoliang and Ooi, Beng Chin and Tan, Kian-lee and Feng, Jianhua},
        series = {{SIGMOD} '15},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/2723372.2750550},
        url = {https://dl.acm.org/doi/10.1145/2723372.2750550},
        year = {2015}
}

Incoming Citations (Sorted by Pagerank)

Showing 23 of 23 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
3,028	Truth Inference in Crowdsourcing: Is the Problem Solved?	2017	VLDB	7.7177453e-05
3,318	Cleaning Crowdsourced Labels Using Oracles for Statistical Classification	2019	VLDB	7.4142395e-05
4,626	Cost-Effective Crowdsourced Entity Resolution: A Partial-Order Approach	2016	SIGMOD	6.480594e-05
4,941	Crowdsourced Top-k Queries by Confidence-Aware Pairwise Judgments	2017	SIGMOD	6.3314694e-05
5,586	Efficient Algorithms for Crowd-Aided Categorization	2020	VLDB	6.0582193e-05
5,830	Domain Adaptation for Deep Entity Resolution	2022	SIGMOD	5.9627079e-05
6,246	Fine-grained Concept Linking using Neural Networks in Healthcare	2018	SIGMOD	5.8200726e-05
6,404	Human-in-the-loop Data Integration	2017	VLDB	5.7797097e-05
6,442	Domain-Aware Multi-Truth Discovery from Conflicting Sources	2018	VLDB	5.7667567e-05
6,791	Crowdsourced Data Management: Overview and Challenges	2017	SIGMOD	5.6647309e-05
6,948	Interactive Graph Search	2019	SIGMOD	5.6210529e-05
7,064	Human-in-the-loop Outlier Detection	2020	SIGMOD	5.5930864e-05
7,074	Cost-Effective Data Annotation using Game-Based Crowdsourcing	2019	VLDB	5.5915502e-05
7,903	Subjective Knowledge Base Construction Powered By Crowdsourcing and Knowledge Base	2018	SIGMOD	5.4135034e-05
8,690	CrowdGame: A Game-Based Crowdsourcing System for Cost-Effective Data Labeling	2019	SIGMOD	5.2726683e-05
9,223	Interactive Graph Search for Multiple Targets on DAGs	2025	VLDB	5.1913816e-05
9,617	CDB: Optimizing Queries with Crowd-Based Selections and Joins	2017	SIGMOD	5.1376962e-05
9,653	SubTab: Data Exploration with Informative Sub-Tables	2022	SIGMOD	5.1310526e-05
10,081	CrowdDQS: Dynamic Question Selection in Crowdsourcing Systems	2017	SIGMOD	5.0732737e-05
10,920	Noisy Interactive Graph Search: An Uncertainty-Based Approach with Online Modeling of Latent Expertise and Difficulty	2026	VLDB	4.9605343e-05
12,261	A Rating-Ranking Method for Crowdsourced Top-k Computation	2018	SIGMOD	4.9605343e-05
12,363	DOCS: Domain-Aware Crowdsourcing System	2017	VLDB	4.9605343e-05
12,407	December: A Declarative Tool for Crowd Member Selection	2016	VLDB	4.9605343e-05

Outgoing Citations (Sorted by Pagerank)

Showing 14 of 14 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
92	CrowdDB: Answering Queries with Crowdsourcing	2011	SIGMOD	0.00034613457
199	CrowdER: Crowdsourcing Entity Resolution	2012	VLDB	0.0002551523
257	Crowdsourced Databases: Query Processing with People	2011	CIDR	0.00022914527
260	Answering Queries using Humans, Algorithms and Databases	2011	CIDR	0.00022866018
266	Human-powered Sorts and Joins	2012	VLDB	0.00022701006
754	So Who Won? Dynamic Max Discovery with the Crowd	2012	SIGMOD	0.00014226032
788	Human-Assisted Graph Search: It’s Okay to Ask Questions	2011	VLDB	0.00013946699
991	CrowdScreen: Algorithms for Filtering Data with Humans	2012	SIGMOD	0.00012632003
1,251	Entity Matching: How Similar Is Similar	2011	VLDB	0.0001132553
1,267	CDAS: A Crowdsourcing Data Analytics System	2012	VLDB	0.00011253716
1,861	CrowdDB: Query Processing with the VLDB Crowd	2011	VLDB	9.4694034e-05
2,650	CrowdFill: Collecting Structured Data from the Crowd	2014	SIGMOD	8.1519618e-05
3,841	Optimal Crowd-Powered Rating and Filtering Algorithms	2014	VLDB	6.9697568e-05
4,237	Whom to Ask? Jury Selection for Decision Making Tasks on Micro-blog Services	2012	VLDB	6.7026224e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	5,276	An Online Cost Sensitive Decision-Making Method in Crowdsourcing Systems	2013	SIGMOD
2	12,273	Crowdsourcing Analytics with CrowdCur	2018	SIGMOD
3	1,267	CDAS: A Crowdsourcing Data Analytics System	2012	VLDB
4	5,052	Crowdsourced Top-k Algorithms: An Experimental Evaluation	2016	VLDB
5	7,396	Hear the Whole Story: Towards the Diversity of Opinion in Crowdsourcing Markets	2015	VLDB
6	8,541	Minimizing Efforts in Validating Crowd Answers	2015	SIGMOD
7	12,443	The Importance of Being Expert: Efficient Max-Finding in Crowdsourcing	2015	SIGMOD
8	12,410	Collaborative Crowdsourcing with Crowd4U	2016	VLDB
9	3,849	QASCA: A Quality-Aware Task Assignment System for Crowdsourcing Applications	2015	SIGMOD
10	10,081	CrowdDQS: Dynamic Question Selection in Crowdsourcing Systems	2017	SIGMOD