DBScholar

Back to papers

Human-powered Sorts and Joins

Summary: Integrates crowds into a declarative workflow (Qurk) to support sorting and joining via MTurk in a DBMS-like interface. Uses task batching, numeric ratings, and pre-filtering to dramatically reduce cost while preserving accuracy and latency. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h806011f202674c64
Venue
VLDB
Year
2012
Pagerank
0.00022739124
Overall Rank
266 | 98.22%
DOI
10.14778/2047485.2047487

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{marcus_vldb12,
        title = {{Human-powered Sorts and Joins}},
        author = {Marcus, Adam and Wu, Eugene and Karger, David and Madden, Samuel and Miller, Robert},
        journal = {PVLDB},
        series = {{VLDB} '12},
        volume = {5},
        number = {1},
        pages = {13--24},
        doi = {10.14778/2047485.2047487},
        url = {https://doi.org/10.14778/2047485.2047487},
        year = {2012}
}

Incoming Citations (Sorted by Pagerank)

Showing 42 of 42 citing papers.

Rank Citing Paper Year Venue Pagerank
134 Deep Entity Matching with Pre-Trained Language Models 2021 VLDB 0.00030043481
198 CrowdER: Crowdsourcing Entity Resolution 2012 VLDB 0.00025555196
433 Corleone: Hands-Off Crowdsourcing for Entity Matching 2014 SIGMOD 0.00018332741
749 So Who Won? Dynamic Max Discovery with the Crowd 2012 SIGMOD 0.00014265279
871 Leveraging Transitive Relations for Crowdsourced Joins 2013 SIGMOD 0.00013343705
933 Question Selection for Crowd Entity Resolution 2013 VLDB 0.00013004422
987 CrowdScreen: Algorithms for Filtering Data with Humans 2012 SIGMOD 0.00012660627
1,472 Crowdsourcing Algorithms for Entity Resolution 2014 VLDB 0.00010558263
1,654 Falcon: Scaling Up Hands-Off Crowdsourced Entity Matching to Build Cloud Services 2017 SIGMOD 9.9739611e-05
1,926 Counting with the Crowd 2013 VLDB 9.3637786e-05
2,642 Scaling Up Crowd-Sourcing to Very Large Datasets: A Case for Active Learning 2015 VLDB 8.1778168e-05
3,171 Truth Inference in Crowdsourcing: Is the Problem Solved? 2017 VLDB 7.5691557e-05
3,197 iCrowd: An Adaptive Crowdsourcing Framework 2015 SIGMOD 7.5455503e-05
3,372 Finish Them!: Pricing Algorithms for Human Computation 2014 VLDB 7.3693102e-05
3,409 Waldo: An Adaptive Human Interface for Crowd Entity Resolution 2017 SIGMOD 7.3264601e-05
3,695 Revisiting Prompt Engineering via Declarative Crowdsourcing 2024 CIDR 7.092445e-05
3,838 Optimal Crowd-Powered Rating and Filtering Algorithms 2014 VLDB 6.9929907e-05
3,839 QASCA: A Quality-Aware Task Assignment System for Crowdsourcing Applications 2015 SIGMOD 6.9921604e-05
4,024 CLAMShell: Speeding up Crowds for Low-latency Data Labeling 2016 VLDB 6.8472018e-05
4,051 Crowd-Based Deduplication: An Adaptive Approach 2015 SIGMOD 6.8285415e-05
4,338 Interactive Join Query Inference with JIM 2014 VLDB 6.6538006e-05
4,518 Arnold: Declarative Crowd-Machine Data Integration 2013 CIDR 6.5632796e-05
4,623 Cost-Effective Crowdsourced Entity Resolution: A Partial-Order Approach 2016 SIGMOD 6.4978811e-05
4,917 Crowdsourced Top-k Queries by Confidence-Aware Pairwise Judgments 2017 SIGMOD 6.3553844e-05
5,024 Crowdsourced Top-k Algorithms: An Experimental Evaluation 2016 VLDB 6.3096186e-05
5,326 Argonaut: Macrotask Crowdsourcing for Complex Data Processing 2015 VLDB 6.178393e-05
5,501 SemBench: A Benchmark for Semantic Query Processing Engines 2026 VLDB 6.1027188e-05
5,570 Efficient Algorithms for Crowd-Aided Categorization 2020 VLDB 6.0811968e-05
6,397 Human-in-the-loop Data Integration 2017 VLDB 5.7989499e-05
6,629 Budget Constrained Interactive Search for Multiple Targets 2021 VLDB 5.7274363e-05
6,668 Query Optimization over Crowdsourced Data 2013 VLDB 5.7147473e-05
7,283 PromptEM: Prompt-tuning for Low-resource Generalized Entity Matching 2023 VLDB 5.5665122e-05
7,371 Hear the Whole Story: Towards the Diversity of Opinion in Crowdsourcing Markets 2015 VLDB 5.5407456e-05
8,200 Algorithmic Complexity Attacks on Dynamic Learned Indexes 2024 VLDB 5.3787447e-05
9,583 CDB: Optimizing Queries with Crowd-Based Selections and Joins 2017 SIGMOD 5.1571823e-05
10,037 CrowdDQS: Dynamic Question Selection in Crowdsourcing Systems 2017 SIGMOD 5.0925155e-05
10,219 Skyline Queries with Noisy Comparisons 2015 PODS 5.0580396e-05
10,220 tDP: An Optimal-Latency Budget Allocation Strategy for Crowdsourced MAXIMUM Operations 2015 SIGMOD 5.0580396e-05
10,845 Featurized-Decomposition Join: Low-Cost Semantic Joins with Guarantees 2026 VLDB 4.9793485e-05
12,212 A Rating-Ranking Method for Crowdsourced Top-k Computation 2018 SIGMOD 4.9793485e-05
12,308 A Confidence-Aware Top-k Query Processing Toolkit on Crowdsourcing 2017 VLDB 4.9793485e-05
12,394 The Importance of Being Expert: Efficient Max-Finding in Crowdsourcing 2015 SIGMOD 4.9793485e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 3 of 3 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
92 CrowdDB: Answering Queries with Crowdsourcing 2011 SIGMOD 0.00034672523
257 Crowdsourced Databases: Query Processing with People 2011 CIDR 0.00022962347
259 Answering Queries using Humans, Algorithms and Databases 2011 CIDR 0.00022923243
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 6,397 Human-in-the-loop Data Integration 2017 VLDB
2 9,583 CDB: Optimizing Queries with Crowd-Based Selections and Joins 2017 SIGMOD
3 987 CrowdScreen: Algorithms for Filtering Data with Humans 2012 SIGMOD
4 5,024 Crowdsourced Top-k Algorithms: An Experimental Evaluation 2016 VLDB
5 5,614 CrowdQ: Crowdsourced Query Understanding 2013 CIDR
6 1,926 Counting with the Crowd 2013 VLDB
7 871 Leveraging Transitive Relations for Crowdsourced Joins 2013 SIGMOD
8 92 CrowdDB: Answering Queries with Crowdsourcing 2011 SIGMOD
9 2,192 Demonstration of Qurk: A Query Processor for Human Operators 2011 SIGMOD
10 257 Crowdsourced Databases: Query Processing with People 2011 CIDR