An Online Cost Sensitive Decision-Making Method in Crowdsourcing Systems

Summary: Online cost-aware framework for crowdsourcing estimates marginal profit in real time and terminates questions when future profit is non-positive. Introduces linear and generalized nonlinear profit models, enables batch HIT publication, and outperforms state-of-the-art on MTurk tasks. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: hcb52fef57175dfd1
Venue: SIGMOD
Year: 2013
Pagerank: 6.206776e-05
Overall Rank: 5,253 | 64.70%
DOI: 10.1145/2463676.2465307

Incoming Non-self Citations Over Time

Authors

1. Jinyang Gao (National University of Singapore)
2. Xuan Liu (National University of Singapore)
3. Beng Chin Ooi (National University of Singapore)
4. Haixun Wang (Microsoft)
5. Gang Chen (Zhejiang University)

BibTeX Citation

@inproceedings{gao_sigmod13,
        title = {{An Online Cost Sensitive Decision-Making Method in Crowdsourcing Systems}},
        author = {Gao, Jinyang and Liu, Xuan and Ooi, Beng Chin and Wang, Haixun and Chen, Gang},
        series = {{SIGMOD} '13},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/2463676.2465307},
        url = {https://dl.acm.org/doi/10.1145/2463676.2465307},
        year = {2013}
}

Incoming Citations (Sorted by Pagerank)

Showing 4 of 4 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
3,308	Cleaning Crowdsourced Labels Using Oracles for Statistical Classification	2019	VLDB	7.4379101e-05
3,840	QASCA: A Quality-Aware Task Assignment System for Crowdsourcing Applications	2015	SIGMOD	6.988858e-05
8,144	Where To: Crowd-Aided Path Selection	2014	VLDB	5.3898812e-05
10,227	gMission: A General Spatial Crowdsourcing Platform	2014	VLDB	5.0556452e-05

Outgoing Citations (Sorted by Pagerank)

Showing 11 of 11 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
92	CrowdDB: Answering Queries with Crowdsourcing	2011	SIGMOD	0.00034670735
198	CrowdER: Crowdsourcing Entity Resolution	2012	VLDB	0.00025546182
257	Crowdsourced Databases: Query Processing with People	2011	CIDR	0.00022958404
259	Answering Queries using Humans, Algorithms and Databases	2011	CIDR	0.00022916014
750	So Who Won? Dynamic Max Discovery with the Crowd	2012	SIGMOD	0.00014258988
787	Human-Assisted Graph Search: It’s Okay to Ask Questions	2011	VLDB	0.00013982951
987	CrowdScreen: Algorithms for Filtering Data with Humans	2012	SIGMOD	0.00012655094
1,265	CDAS: A Crowdsourcing Data Analytics System	2012	VLDB	0.00011277921
1,852	CrowdDB: Query Processing with the VLDB Crowd	2011	VLDB	9.4992704e-05
2,194	Demonstration of Qurk: A Query Processor for Human Operators	2011	SIGMOD	8.8780295e-05
7,789	Pushing the Boundaries of Crowd-enabled Databases with Query-driven Schema Expansion	2012	VLDB	5.4509595e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	12,218	A Rating-Ranking Method for Crowdsourced Top-k Computation	2018	SIGMOD
2	11,885	Decentralized Crowdsourcing for Human Intelligence Tasks with Efficient On-Chain Cost	2022	VLDB
3	3,173	Truth Inference in Crowdsourcing: Is the Problem Solved?	2017	VLDB
4	987	CrowdScreen: Algorithms for Filtering Data with Humans	2012	SIGMOD
5	1,265	CDAS: A Crowdsourcing Data Analytics System	2012	VLDB
6	3,839	Optimal Crowd-Powered Rating and Filtering Algorithms	2014	VLDB
7	2,643	Scaling Up Crowd-Sourcing to Very Large Datasets: A Case for Active Learning	2015	VLDB
8	12,400	The Importance of Being Expert: Efficient Max-Finding in Crowdsourcing	2015	SIGMOD
9	8,524	Minimizing Efforts in Validating Crowd Answers	2015	SIGMOD
10	5,572	Efficient Algorithms for Crowd-Aided Categorization	2020	VLDB