Database Paper Browser

Back to papers

Human-powered Sorts and Joins

Summary: Integrates crowds into a declarative workflow (Qurk) to support sorting and joining via MTurk in a DBMS-like interface. Uses task batching, numeric ratings, and pre-filtering to dramatically reduce cost while preserving accuracy and latency. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
10333
Venue
VLDB
Year
2012
Pagerank
0.00029884758
Overall Rank
266 | 98.16%
DOI
-

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 41 of 41 citing papers.

Rank Citing Paper Year Venue Pagerank
219 Deep Entity Matching with Pre-Trained Language Models 2021 VLDB 0.00033354456
265 CrowdER: Crowdsourcing Entity Resolution 2012 VLDB 0.00029904018
641 Corleone: Hands-Off Crowdsourcing for Entity Matching 2014 SIGMOD 0.00018759417
854 So Who Won? Dynamic Max Discovery with the Crowd 2012 SIGMOD 0.00015879917
863 Leveraging Transitive Relations for Crowdsourced Joins 2013 SIGMOD 0.00015793243
1,154 CrowdScreen: Algorithms for Filtering Data with Humans 2012 SIGMOD 0.00013616867
1,242 Question Selection for Crowd Entity Resolution 2013 VLDB 0.00013088272
1,842 Crowdsourcing Algorithms for Entity Resolution 2014 VLDB 0.00010342022
2,176 Falcon: Scaling Up Hands-Off Crowdsourced Entity Matching to Build Cloud Services 2017 SIGMOD 9.3729351e-05
2,255 Counting with the Crowd 2013 VLDB 9.1846281e-05
2,796 Finish Them!: Pricing Algorithms for Human Computation 2014 VLDB 8.1119959e-05
2,944 Truth Inference in Crowdsourcing: Is the Problem Solved? 2017 VLDB 7.8457167e-05
3,020 Scaling Up Crowd-Sourcing to Very Large Datasets: A Case for Active Learning 2015 VLDB 7.6987905e-05
3,268 QASCA: A Quality-Aware Task Assignment System for Crowdsourcing Applications 2015 SIGMOD 7.3027561e-05
3,324 iCrowd: An Adaptive Crowdsourcing Framework 2015 SIGMOD 7.2163115e-05
3,803 Revisiting Prompt Engineering via Declarative Crowdsourcing 2024 CIDR 6.7498941e-05
4,112 Waldo: An Adaptive Human Interface for Crowd Entity Resolution 2017 SIGMOD 6.4329055e-05
4,181 Arnold: Declarative Crowd-Machine Data Integration 2013 CIDR 6.3725128e-05
4,419 Interactive Join Query Inference with JIM 2014 VLDB 6.1948404e-05
4,453 CLAMShell: Speeding up Crowds for Low-latency Data Labeling 2016 VLDB 6.1690121e-05
4,483 Optimal Crowd-Powered Rating and Filtering Algorithms 2014 VLDB 6.1431599e-05
4,580 Crowdsourced Top-k Algorithms: An Experimental Evaluation 2016 VLDB 6.0646299e-05
4,617 Crowd-Based Deduplication: An Adaptive Approach 2015 SIGMOD 6.0400801e-05
4,662 Argonaut: Macrotask Crowdsourcing for Complex Data Processing 2015 VLDB 6.006757e-05
5,029 Crowdsourced Top-k Queries by Confidence-Aware Pairwise Judgments 2017 SIGMOD 5.7447454e-05
5,369 Cost-Effective Crowdsourced Entity Resolution: A Partial-Order Approach 2016 SIGMOD 5.5436995e-05
5,744 Efficient Algorithms for Crowd-Aided Categorization 2020 VLDB 5.343155e-05
6,583 Budget Constrained Interactive Search for Multiple Targets 2021 VLDB 4.9979684e-05
6,801 Query Optimization over Crowdsourced Data 2013 VLDB 4.9175463e-05
7,025 Hear the Whole Story: Towards the Diversity of Opinion in Crowdsourcing Markets 2015 VLDB 4.8530001e-05
7,667 Human-in-the-loop Data Integration 2017 VLDB 4.6791871e-05
8,668 Algorithmic Complexity Attacks on Dynamic Learned Indexes 2024 VLDB 4.4671214e-05
8,913 PromptEM: Prompt-tuning for Low-resource Generalized Entity Matching 2023 VLDB 4.4229886e-05
9,865 Skyline Queries with Noisy Comparisons 2015 PODS 4.2634671e-05
9,866 tDP: An Optimal-Latency Budget Allocation Strategy for Crowdsourced MAXIMUM Operations 2015 SIGMOD 4.2634671e-05
10,277 SemBench: A Benchmark for Semantic Query Processing Engines 2026 VLDB 4.1905499e-05
11,713 A Rating-Ranking Method for Crowdsourced Top-k Computation 2018 SIGMOD 4.1905499e-05
11,796 CDB: Optimizing Queries with Crowd-Based Selections and Joins 2017 SIGMOD 4.1905499e-05
11,799 CrowdDQS: Dynamic Question Selection in Crowdsourcing Systems 2017 SIGMOD 4.1905499e-05
11,818 A Confidence-Aware Top-k Query Processing Toolkit on Crowdsourcing 2017 VLDB 4.1905499e-05
11,910 The Importance of Being Expert: Efficient Max-Finding in Crowdsourcing 2015 SIGMOD 4.1905499e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 3 of 3 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
94 CrowdDB: Answering Queries with Crowdsourcing 2011 SIGMOD 0.00051273089
118 Answering Queries using Humans, Algorithms and Databases 2011 CIDR 0.00045860394
246 Crowdsourced Databases: Query Processing with People 2011 CIDR 0.00030952631
Previous Page 1 / 1 Next

Semantically Similar Papers

Overall Rank Paper Year Venue Pagerank
7,667 Human-in-the-loop Data Integration 2017 VLDB 4.6791871e-05
11,796 CDB: Optimizing Queries with Crowd-Based Selections and Joins 2017 SIGMOD 4.1905499e-05
1,154 CrowdScreen: Algorithms for Filtering Data with Humans 2012 SIGMOD 0.00013616867
4,580 Crowdsourced Top-k Algorithms: An Experimental Evaluation 2016 VLDB 6.0646299e-05
3,939 CrowdQ: Crowdsourced Query Understanding 2013 CIDR 6.6099823e-05
2,255 Counting with the Crowd 2013 VLDB 9.1846281e-05
863 Leveraging Transitive Relations for Crowdsourced Joins 2013 SIGMOD 0.00015793243
94 CrowdDB: Answering Queries with Crowdsourcing 2011 SIGMOD 0.00051273089
2,121 Demonstration of Qurk: A Query Processor for Human Operators 2011 SIGMOD 9.4930973e-05
246 Crowdsourced Databases: Query Processing with People 2011 CIDR 0.00030952631