Crowdsourced Top-k Algorithms: An Experimental Evaluation
Summary: Comprehensive experimental comparison of heuristic database and learning-based crowdsourced top-k algorithms under noisy worker judgments. Evaluates quality and efficiency on synthetic/real data and live platforms, exposing method tradeoffs and offering scenario-specific selection guidance. (summarized by gpt-5.6-luna on Jul 24 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Xiaohang Zhang (Tsinghua University)
- 2. Guoliang Li (Tsinghua University)
- 3. Jianhua Feng (Tsinghua University)
BibTeX Citation
@article{zhang_vldb16,
title = {{Crowdsourced Top-k Algorithms: An Experimental Evaluation}},
author = {Zhang, Xiaohang and Li, Guoliang and Feng, Jianhua},
journal = {PVLDB},
series = {{VLDB} '16},
volume = {9},
number = {8},
doi = {10.14778/2921558.2921559},
url = {https://doi.org/10.14778/2921558.2921559},
year = {2016}
}Incoming Citations (Sorted by Pagerank)
Showing 9 of 9 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 3,171 | Truth Inference in Crowdsourcing: Is the Problem Solved? | 2017 | VLDB | 7.5691557e-05 |
| 4,478 | Top-k Sorting Under Partial Order Information | 2018 | SIGMOD | 6.5814419e-05 |
| 4,917 | Crowdsourced Top-k Queries by Confidence-Aware Pairwise Judgments | 2017 | SIGMOD | 6.3553844e-05 |
| 5,061 | CDB: A Crowd-Powered Database System | 2018 | VLDB | 6.2912543e-05 |
| 7,500 | Crowdsourced Data Management: Overview and Challenges | 2017 | SIGMOD | 5.5083793e-05 |
| 9,397 | Satisfying Complex Top-k Fairness Constraints by Preference Substitutions | 2023 | VLDB | 5.1849689e-05 |
| 9,583 | CDB: Optimizing Queries with Crowd-Based Selections and Joins | 2017 | SIGMOD | 5.1571823e-05 |
| 12,212 | A Rating-Ranking Method for Crowdsourced Top-k Computation | 2018 | SIGMOD | 4.9793485e-05 |
| 12,314 | DOCS: Domain-Aware Crowdsourcing System | 2017 | VLDB | 4.9793485e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 2 of 2 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 266 | Human-powered Sorts and Joins | 2012 | VLDB | 0.00022739124 |
| 749 | So Who Won? Dynamic Max Discovery with the Crowd | 2012 | SIGMOD | 0.00014265279 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 1,535 | Top-k Query Evaluation with Probabilistic Guarantees | 2004 | VLDB |
| 2 | 3,171 | Truth Inference in Crowdsourcing: Is the Problem Solved? | 2017 | VLDB |
| 3 | 5,570 | Efficient Algorithms for Crowd-Aided Categorization | 2020 | VLDB |
| 4 | 92 | CrowdDB: Answering Queries with Crowdsourcing | 2011 | SIGMOD |
| 5 | 7,556 | An Experimental Evaluation of Task Assignment in Spatial Crowdsourcing | 2018 | VLDB |
| 6 | 12,394 | The Importance of Being Expert: Efficient Max-Finding in Crowdsourcing | 2015 | SIGMOD |
| 7 | 4,917 | Crowdsourced Top-k Queries by Confidence-Aware Pairwise Judgments | 2017 | SIGMOD |
| 8 | 12,308 | A Confidence-Aware Top-k Query Processing Toolkit on Crowdsourcing | 2017 | VLDB |
| 9 | 4,478 | Top-k Sorting Under Partial Order Information | 2018 | SIGMOD |
| 10 | 12,212 | A Rating-Ranking Method for Crowdsourced Top-k Computation | 2018 | SIGMOD |