DBScholar

Back to papers

QASCA: A Quality-Aware Task Assignment System for Crowdsourcing Applications

Summary: QASCA is a quality-aware online task assignment system for crowdsourcing on AMT. It models probabilistic ground truths from worker answers to optimize Accuracy and F-score, delivering linear-time assignment and achieving about 8% quality gains across five real applications. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
ha6f6972d3829b17d
Venue
SIGMOD
Year
2015
Pagerank
6.988858e-05
Overall Rank
3,840 | 74.20%
DOI
10.1145/2723372.2749430

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{zheng_sigmod15,
        title = {{QASCA: A Quality-Aware Task Assignment System for Crowdsourcing Applications}},
        author = {Zheng, Yudian and Wang, Jiannan and Li, Guoliang and Cheng, Reynold and Feng, Jianhua},
        series = {{SIGMOD} '15},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/2723372.2749430},
        url = {https://dl.acm.org/doi/10.1145/2723372.2749430},
        year = {2015}
}

Incoming Citations (Sorted by Pagerank)

Showing 18 of 18 citing papers.

Rank Citing Paper Year Venue Pagerank
3,173 Truth Inference in Crowdsourcing: Is the Problem Solved? 2017 VLDB 7.5655739e-05
3,308 Cleaning Crowdsourced Labels Using Oracles for Statistical Classification 2019 VLDB 7.4379101e-05
4,625 Cost-Effective Crowdsourced Entity Resolution: A Partial-Order Approach 2016 SIGMOD 6.4948389e-05
5,050 CDB: A Crowd-Powered Database System 2018 VLDB 6.2955765e-05
5,572 Efficient Algorithms for Crowd-Aided Categorization 2020 VLDB 6.078318e-05
6,400 Human-in-the-loop Data Integration 2017 VLDB 5.7962311e-05
7,043 Human-in-the-loop Outlier Detection 2020 SIGMOD 5.611642e-05
7,054 Cost-Effective Data Annotation using Game-Based Crowdsourcing 2019 VLDB 5.6101007e-05
7,505 Crowdsourced Data Management: Overview and Challenges 2017 SIGMOD 5.5057737e-05
7,889 Subjective Knowledge Base Construction Powered By Crowdsourcing and Knowledge Base 2018 SIGMOD 5.4312213e-05
9,591 CDB: Optimizing Queries with Crowd-Based Selections and Joins 2017 SIGMOD 5.154741e-05
10,042 CrowdDQS: Dynamic Question Selection in Crowdsourcing Systems 2017 SIGMOD 5.0901047e-05
10,528 Weighted Set Multi-Cover on Bounded Universe and Applications in Package Recommendation 2026 SIGMOD 4.9769913e-05
10,859 Noisy Interactive Graph Search: An Uncertainty-Based Approach with Online Modeling of Latent Expertise and Difficulty 2026 VLDB 4.9769913e-05
12,114 CONCIERGE: Improving Constrained Search Results by Data Melioration 2020 VLDB 4.9769913e-05
12,218 A Rating-Ranking Method for Crowdsourced Top-k Computation 2018 SIGMOD 4.9769913e-05
12,260 Worker Recommendation for Crowdsourced Q&A Services: A Triple-Factor Aware Approach 2018 VLDB 4.9769913e-05
12,320 DOCS: Domain-Aware Crowdsourcing System 2017 VLDB 4.9769913e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 21 of 21 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
92 CrowdDB: Answering Queries with Crowdsourcing 2011 SIGMOD 0.00034670735
198 CrowdER: Crowdsourcing Entity Resolution 2012 VLDB 0.00025546182
257 Crowdsourced Databases: Query Processing with People 2011 CIDR 0.00022958404
266 Human-powered Sorts and Joins 2012 VLDB 0.00022735106
360 Efficient Parallel Set-Similarity Joins Using MapReduce 2010 SIGMOD 0.00020001237
504 A Bayesian Approach to Discovering Truth from Conflicting Sources for Data Integration 2012 VLDB 0.00017156765
750 So Who Won? Dynamic Max Discovery with the Crowd 2012 SIGMOD 0.00014258988
871 Leveraging Transitive Relations for Crowdsourced Joins 2013 SIGMOD 0.00013338722
888 Pay-as-you-go User Feedback for Dataspace Systems 2008 SIGMOD 0.00013250185
934 Question Selection for Crowd Entity Resolution 2013 VLDB 0.00012998402
938 Truth Finding on the Deep Web: Is the Problem Solved? 2013 VLDB 0.00012967324
965 Can We Beat the Prefix Filtering? An Adaptive Framework for Similarity Join and Search 2012 SIGMOD 0.00012810695
987 CrowdScreen: Algorithms for Filtering Data with Humans 2012 SIGMOD 0.00012655094
1,265 CDAS: A Crowdsourcing Data Analytics System 2012 VLDB 0.00011277921
1,284 Fusing Data with Correlations 2014 SIGMOD 0.00011197034
1,722 A Sample-and-Clean Framework for Fast and Accurate Query Processing on Dirty Data 2014 SIGMOD 9.7921604e-05
1,926 Counting with the Crowd 2013 VLDB 9.3636304e-05
2,430 Deco: A System for Declarative Crowdsourcing 2012 VLDB 8.4763599e-05
3,240 Evaluating Entity Resolution Results 2010 VLDB 7.4979039e-05
4,604 Reducing Uncertainty of Schema Matching via Crowdsourcing 2013 VLDB 6.504145e-05
5,253 An Online Cost Sensitive Decision-Making Method in Crowdsourcing Systems 2013 SIGMOD 6.206776e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 2,643 Scaling Up Crowd-Sourcing to Very Large Datasets: A Case for Active Learning 2015 VLDB
2 7,562 An Experimental Evaluation of Task Assignment in Spatial Crowdsourcing 2018 VLDB
3 8,524 Minimizing Efforts in Validating Crowd Answers 2015 SIGMOD
4 934 Question Selection for Crowd Entity Resolution 2013 VLDB
5 12,260 Worker Recommendation for Crowdsourced Q&A Services: A Triple-Factor Aware Approach 2018 VLDB
6 7,822 Towards Globally Optimal Crowdsourcing Quality Management: The Uniform Worker Setting 2016 SIGMOD
7 5,253 An Online Cost Sensitive Decision-Making Method in Crowdsourcing Systems 2013 SIGMOD
8 1,265 CDAS: A Crowdsourcing Data Analytics System 2012 VLDB
9 3,199 iCrowd: An Adaptive Crowdsourcing Framework 2015 SIGMOD
10 10,042 CrowdDQS: Dynamic Question Selection in Crowdsourcing Systems 2017 SIGMOD