DBScholar

Back to papers

Human-powered Sorts and Joins

Summary: Integrates crowds into a declarative workflow (Qurk) to support sorting and joining via MTurk in a DBMS-like interface. Uses task batching, numeric ratings, and pre-filtering to dramatically reduce cost while preserving accuracy and latency. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h806011f202674c64
Venue
VLDB
Year
2012
Pagerank
0.00022735106
Overall Rank
266 | 98.22%
DOI
10.14778/2047485.2047487

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{marcus_vldb12,
        title = {{Human-powered Sorts and Joins}},
        author = {Marcus, Adam and Wu, Eugene and Karger, David and Madden, Samuel and Miller, Robert},
        journal = {PVLDB},
        series = {{VLDB} '12},
        volume = {5},
        number = {1},
        pages = {13--24},
        doi = {10.14778/2047485.2047487},
        url = {https://doi.org/10.14778/2047485.2047487},
        year = {2012}
}

Incoming Citations (Sorted by Pagerank)

Showing 42 of 42 citing papers.

Rank Citing Paper Year Venue Pagerank
134 Deep Entity Matching with Pre-Trained Language Models 2021 VLDB 0.00030042569
198 CrowdER: Crowdsourcing Entity Resolution 2012 VLDB 0.00025546182
433 Corleone: Hands-Off Crowdsourcing for Entity Matching 2014 SIGMOD 0.00018324965
750 So Who Won? Dynamic Max Discovery with the Crowd 2012 SIGMOD 0.00014258988
871 Leveraging Transitive Relations for Crowdsourced Joins 2013 SIGMOD 0.00013338722
934 Question Selection for Crowd Entity Resolution 2013 VLDB 0.00012998402
987 CrowdScreen: Algorithms for Filtering Data with Humans 2012 SIGMOD 0.00012655094
1,472 Crowdsourcing Algorithms for Entity Resolution 2014 VLDB 0.00010553304
1,655 Falcon: Scaling Up Hands-Off Crowdsourced Entity Matching to Build Cloud Services 2017 SIGMOD 9.9694129e-05
1,926 Counting with the Crowd 2013 VLDB 9.3636304e-05
2,643 Scaling Up Crowd-Sourcing to Very Large Datasets: A Case for Active Learning 2015 VLDB 8.1741373e-05
3,173 Truth Inference in Crowdsourcing: Is the Problem Solved? 2017 VLDB 7.5655739e-05
3,199 iCrowd: An Adaptive Crowdsourcing Framework 2015 SIGMOD 7.5419863e-05
3,372 Finish Them!: Pricing Algorithms for Human Computation 2014 VLDB 7.3658309e-05
3,409 Waldo: An Adaptive Human Interface for Crowd Entity Resolution 2017 SIGMOD 7.3230153e-05
3,668 Revisiting Prompt Engineering via Declarative Crowdsourcing 2024 CIDR 7.1144218e-05
3,839 Optimal Crowd-Powered Rating and Filtering Algorithms 2014 VLDB 6.9896853e-05
3,840 QASCA: A Quality-Aware Task Assignment System for Crowdsourcing Applications 2015 SIGMOD 6.988858e-05
4,025 CLAMShell: Speeding up Crowds for Low-latency Data Labeling 2016 VLDB 6.8439934e-05
4,053 Crowd-Based Deduplication: An Adaptive Approach 2015 SIGMOD 6.8253348e-05
4,338 Interactive Join Query Inference with JIM 2014 VLDB 6.6506652e-05
4,519 Arnold: Declarative Crowd-Machine Data Integration 2013 CIDR 6.5602428e-05
4,625 Cost-Effective Crowdsourced Entity Resolution: A Partial-Order Approach 2016 SIGMOD 6.4948389e-05
4,918 Crowdsourced Top-k Queries by Confidence-Aware Pairwise Judgments 2017 SIGMOD 6.3523802e-05
5,027 Crowdsourced Top-k Algorithms: An Experimental Evaluation 2016 VLDB 6.3066319e-05
5,309 SemBench: A Benchmark for Semantic Query Processing Engines 2026 VLDB 6.1841176e-05
5,333 Argonaut: Macrotask Crowdsourcing for Complex Data Processing 2015 VLDB 6.1754682e-05
5,572 Efficient Algorithms for Crowd-Aided Categorization 2020 VLDB 6.078318e-05
6,400 Human-in-the-loop Data Integration 2017 VLDB 5.7962311e-05
6,633 Budget Constrained Interactive Search for Multiple Targets 2021 VLDB 5.724725e-05
6,672 Query Optimization over Crowdsourced Data 2013 VLDB 5.7120461e-05
7,286 PromptEM: Prompt-tuning for Low-resource Generalized Entity Matching 2023 VLDB 5.5638771e-05
7,377 Hear the Whole Story: Towards the Diversity of Opinion in Crowdsourcing Markets 2015 VLDB 5.5381227e-05
8,208 Algorithmic Complexity Attacks on Dynamic Learned Indexes 2024 VLDB 5.3761984e-05
9,591 CDB: Optimizing Queries with Crowd-Based Selections and Joins 2017 SIGMOD 5.154741e-05
10,042 CrowdDQS: Dynamic Question Selection in Crowdsourcing Systems 2017 SIGMOD 5.0901047e-05
10,199 Featurized-Decomposition Join: Low-Cost Semantic Joins with Guarantees 2026 VLDB 5.0599411e-05
10,225 Skyline Queries with Noisy Comparisons 2015 PODS 5.0556452e-05
10,226 tDP: An Optimal-Latency Budget Allocation Strategy for Crowdsourced MAXIMUM Operations 2015 SIGMOD 5.0556452e-05
12,218 A Rating-Ranking Method for Crowdsourced Top-k Computation 2018 SIGMOD 4.9769913e-05
12,314 A Confidence-Aware Top-k Query Processing Toolkit on Crowdsourcing 2017 VLDB 4.9769913e-05
12,400 The Importance of Being Expert: Efficient Max-Finding in Crowdsourcing 2015 SIGMOD 4.9769913e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 3 of 3 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
92 CrowdDB: Answering Queries with Crowdsourcing 2011 SIGMOD 0.00034670735
257 Crowdsourced Databases: Query Processing with People 2011 CIDR 0.00022958404
259 Answering Queries using Humans, Algorithms and Databases 2011 CIDR 0.00022916014
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 6,400 Human-in-the-loop Data Integration 2017 VLDB
2 9,591 CDB: Optimizing Queries with Crowd-Based Selections and Joins 2017 SIGMOD
3 987 CrowdScreen: Algorithms for Filtering Data with Humans 2012 SIGMOD
4 5,027 Crowdsourced Top-k Algorithms: An Experimental Evaluation 2016 VLDB
5 5,615 CrowdQ: Crowdsourced Query Understanding 2013 CIDR
6 1,926 Counting with the Crowd 2013 VLDB
7 871 Leveraging Transitive Relations for Crowdsourced Joins 2013 SIGMOD
8 92 CrowdDB: Answering Queries with Crowdsourcing 2011 SIGMOD
9 2,194 Demonstration of Qurk: A Query Processor for Human Operators 2011 SIGMOD
10 257 Crowdsourced Databases: Query Processing with People 2011 CIDR