DBScholar

Back to papers

Human-powered Sorts and Joins

Summary: Integrates crowds into a declarative workflow (Qurk) to support sorting and joining via MTurk in a DBMS-like interface. Uses task batching, numeric ratings, and pre-filtering to dramatically reduce cost while preserving accuracy and latency. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h806011f202674c64
Venue
VLDB
Year
2012
Pagerank
0.00022701006
Overall Rank
266 | 98.22%
DOI
10.14778/2047485.2047487

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{marcus_vldb12,
        title = {{Human-powered Sorts and Joins}},
        author = {Marcus, Adam and Wu, Eugene and Karger, David and Madden, Samuel and Miller, Robert},
        journal = {PVLDB},
        series = {{VLDB} '12},
        volume = {5},
        number = {1},
        pages = {13--24},
        doi = {10.14778/2047485.2047487},
        url = {https://doi.org/10.14778/2047485.2047487},
        year = {2012}
}

Incoming Citations (Sorted by Pagerank)

Showing 42 of 42 citing papers.

Rank Citing Paper Year Venue Pagerank
132 Deep Entity Matching with Pre-Trained Language Models 2021 VLDB 0.00030213215
199 CrowdER: Crowdsourcing Entity Resolution 2012 VLDB 0.0002551523
434 Corleone: Hands-Off Crowdsourcing for Entity Matching 2014 SIGMOD 0.00018323777
754 So Who Won? Dynamic Max Discovery with the Crowd 2012 SIGMOD 0.00014226032
873 Leveraging Transitive Relations for Crowdsourced Joins 2013 SIGMOD 0.00013306946
932 Question Selection for Crowd Entity Resolution 2013 VLDB 0.00012981731
991 CrowdScreen: Algorithms for Filtering Data with Humans 2012 SIGMOD 0.00012632003
1,473 Crowdsourcing Algorithms for Entity Resolution 2014 VLDB 0.0001052886
1,650 Falcon: Scaling Up Hands-Off Crowdsourced Entity Matching to Build Cloud Services 2017 SIGMOD 9.9690948e-05
1,932 Counting with the Crowd 2013 VLDB 9.3441665e-05
2,647 Scaling Up Crowd-Sourcing to Very Large Datasets: A Case for Active Learning 2015 VLDB 8.1565673e-05
3,028 Truth Inference in Crowdsourcing: Is the Problem Solved? 2017 VLDB 7.7177453e-05
3,210 iCrowd: An Adaptive Crowdsourcing Framework 2015 SIGMOD 7.5170875e-05
3,368 Finish Them!: Pricing Algorithms for Human Computation 2014 VLDB 7.351092e-05
3,414 Waldo: An Adaptive Human Interface for Crowd Entity Resolution 2017 SIGMOD 7.3058225e-05
3,659 Revisiting Prompt Engineering via Declarative Crowdsourcing 2024 CIDR 7.1094444e-05
3,841 Optimal Crowd-Powered Rating and Filtering Algorithms 2014 VLDB 6.9697568e-05
3,849 QASCA: A Quality-Aware Task Assignment System for Crowdsourcing Applications 2015 SIGMOD 6.9657571e-05
4,029 CLAMShell: Speeding up Crowds for Low-latency Data Labeling 2016 VLDB 6.8285702e-05
4,074 Crowd-Based Deduplication: An Adaptive Approach 2015 SIGMOD 6.8062505e-05
4,358 Interactive Join Query Inference with JIM 2014 VLDB 6.6287141e-05
4,537 Arnold: Declarative Crowd-Machine Data Integration 2013 CIDR 6.5399966e-05
4,626 Cost-Effective Crowdsourced Entity Resolution: A Partial-Order Approach 2016 SIGMOD 6.480594e-05
4,941 Crowdsourced Top-k Queries by Confidence-Aware Pairwise Judgments 2017 SIGMOD 6.3314694e-05
4,996 SemBench: A Benchmark for Semantic Query Processing Engines 2026 VLDB 6.3095672e-05
5,052 Crowdsourced Top-k Algorithms: An Experimental Evaluation 2016 VLDB 6.2857835e-05
5,344 Argonaut: Macrotask Crowdsourcing for Complex Data Processing 2015 VLDB 6.1575792e-05
5,586 Efficient Algorithms for Crowd-Aided Categorization 2020 VLDB 6.0582193e-05
6,404 Human-in-the-loop Data Integration 2017 VLDB 5.7797097e-05
6,644 Budget Constrained Interactive Search for Multiple Targets 2021 VLDB 5.7057955e-05
6,684 Query Optimization over Crowdsourced Data 2013 VLDB 5.6940605e-05
7,304 PromptEM: Prompt-tuning for Low-resource Generalized Entity Matching 2023 VLDB 5.5454795e-05
7,396 Hear the Whole Story: Towards the Diversity of Opinion in Crowdsourcing Markets 2015 VLDB 5.5198102e-05
8,223 Algorithmic Complexity Attacks on Dynamic Learned Indexes 2024 VLDB 5.3584214e-05
9,617 CDB: Optimizing Queries with Crowd-Based Selections and Joins 2017 SIGMOD 5.1376962e-05
10,081 CrowdDQS: Dynamic Question Selection in Crowdsourcing Systems 2017 SIGMOD 5.0732737e-05
10,232 Featurized-Decomposition Join: Low-Cost Semantic Joins with Guarantees 2026 VLDB 5.0432098e-05
10,245 Skyline Queries with Noisy Comparisons 2015 PODS 5.041459e-05
10,246 tDP: An Optimal-Latency Budget Allocation Strategy for Crowdsourced MAXIMUM Operations 2015 SIGMOD 5.041459e-05
12,261 A Rating-Ranking Method for Crowdsourced Top-k Computation 2018 SIGMOD 4.9605343e-05
12,357 A Confidence-Aware Top-k Query Processing Toolkit on Crowdsourcing 2017 VLDB 4.9605343e-05
12,443 The Importance of Being Expert: Efficient Max-Finding in Crowdsourcing 2015 SIGMOD 4.9605343e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 3 of 3 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
92 CrowdDB: Answering Queries with Crowdsourcing 2011 SIGMOD 0.00034613457
257 Crowdsourced Databases: Query Processing with People 2011 CIDR 0.00022914527
260 Answering Queries using Humans, Algorithms and Databases 2011 CIDR 0.00022866018
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 6,404 Human-in-the-loop Data Integration 2017 VLDB
2 9,617 CDB: Optimizing Queries with Crowd-Based Selections and Joins 2017 SIGMOD
3 991 CrowdScreen: Algorithms for Filtering Data with Humans 2012 SIGMOD
4 5,052 Crowdsourced Top-k Algorithms: An Experimental Evaluation 2016 VLDB
5 5,627 CrowdQ: Crowdsourced Query Understanding 2013 CIDR
6 1,932 Counting with the Crowd 2013 VLDB
7 873 Leveraging Transitive Relations for Crowdsourced Joins 2013 SIGMOD
8 92 CrowdDB: Answering Queries with Crowdsourcing 2011 SIGMOD
9 2,205 Demonstration of Qurk: A Query Processor for Human Operators 2011 SIGMOD
10 257 Crowdsourced Databases: Query Processing with People 2011 CIDR