Database Paper Browser

Back to papers

Crowdsourced Databases: Query Processing with People

Summary: Presents Qurk, a crowdsourced DBMS that exposes humans on MTurk as query operators to perform filtering, sorting, joining, and aggregation via HIT workflows. Analyzes execution and optimization challenges unique to human-in-the-loop queries—cost/latency/accuracy tradeoffs, batching, operator design, and techniques to minimize HITs and improve result quality. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID
161
Venue
CIDR
Year
2011
Pagerank
0.00030740523
Overall Rank
249 | 98.27%
DOI
-

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 47 of 47 citing papers.

Rank Citing Paper Year Venue Pagerank
94 CrowdDB: Answering Queries with Crowdsourcing 2011 SIGMOD 0.00051013264
263 CrowdER: Crowdsourcing Entity Resolution 2012 VLDB 0.00029862413
267 Human-powered Sorts and Joins 2012 VLDB 0.00029690405
643 Corleone: Hands-Off Crowdsourcing for Entity Matching 2014 SIGMOD 0.00018754451
1,164 CrowdScreen: Algorithms for Filtering Data with Humans 2012 SIGMOD 0.00013564823
1,491 CDAS: A Crowdsourcing Data Analytics System 2012 VLDB 0.00011694982
1,840 dbTouch: Analytics at your Fingertips 2013 CIDR 0.0001034905
1,963 DocETL: Agentic Query Rewriting and Evaluation for Complex Document Processing 2025 VLDB 9.929429e-05
2,123 Demonstration of Qurk: A Query Processor for Human Operators 2011 SIGMOD 9.4945521e-05
2,175 Falcon: Scaling Up Hands-Off Crowdsourced Entity Matching to Build Cloud Services 2017 SIGMOD 9.3644117e-05
2,334 Counting with the Crowd 2013 VLDB 9.0161817e-05
2,937 Truth Inference in Crowdsourcing: Is the Problem Solved? 2017 VLDB 7.853108e-05
3,100 Crowd Mining 2013 SIGMOD 7.5634778e-05
3,263 QASCA: A Quality-Aware Task Assignment System for Crowdsourcing Applications 2015 SIGMOD 7.3097573e-05
3,322 iCrowd: An Adaptive Crowdsourcing Framework 2015 SIGMOD 7.2230626e-05
3,840 Revisiting Prompt Engineering via Declarative Crowdsourcing 2024 CIDR 6.7106924e-05
3,935 CrowdQ: Crowdsourced Query Understanding 2013 CIDR 6.6163464e-05
4,185 Arnold: Declarative Crowd-Machine Data Integration 2013 CIDR 6.3776356e-05
4,479 Optimal Crowd-Powered Rating and Filtering Algorithms 2014 VLDB 6.149053e-05
4,535 Hybrid Querying Over Relational Databases and Large Language Models 2025 CIDR 6.1049669e-05
4,651 Whom to Ask? Jury Selection for Decision Making Tasks on Micro-blog Services 2012 VLDB 6.022931e-05
4,827 An Online Cost Sensitive Decision-Making Method in Crowdsourcing Systems 2013 SIGMOD 5.8938399e-05
5,279 CDB: A Crowd-Powered Database System 2018 VLDB 5.5902418e-05
5,362 Cost-Effective Crowdsourced Entity Resolution: A Partial-Order Approach 2016 SIGMOD 5.5473503e-05
5,450 Crowdsourcing Applications and Platforms: A Data Management Perspective 2011 VLDB 5.5003491e-05
5,658 Databases Unbound: Querying All of the World's Bytes with AI 2024 VLDB 5.385675e-05
5,734 Efficient Algorithms for Crowd-Aided Categorization 2020 VLDB 5.3482904e-05
6,941 Estimating the Impact of Unknown Unknowns on Aggregate Query Results 2016 SIGMOD 4.8924e-05
6,955 Inspector Gadget: A Data Programming-based Labeling System for Industrial Images 2021 VLDB 4.8864297e-05
7,113 Answering Planning Queries with the Crowd 2013 VLDB 4.8274062e-05
7,117 Crowdsourced Data Management: Overview and Challenges 2017 SIGMOD 4.826509e-05
7,535 Interactive Graph Search 2019 SIGMOD 4.7178467e-05
7,572 Pushing the Boundaries of Crowd-enabled Databases with Query-driven Schema Expansion 2012 VLDB 4.7075553e-05
7,575 Human-in-the-loop Outlier Detection 2020 SIGMOD 4.7068909e-05
7,668 Human-in-the-loop Data Integration 2017 VLDB 4.6834075e-05
8,517 Understanding Workers, Developing Effective Tasks, and Enhancing Marketplace Dynamics: A Study of a Large Crowdsourcing Marketplace 2017 VLDB 4.4943871e-05
8,694 Managing General and Individual Knowledge in Crowd Mining Applications 2015 CIDR 4.4661379e-05
9,043 Query-Guided Resolution in Uncertain Databases 2023 SIGMOD 4.4039656e-05
9,729 Semantic Integrity Constraints: Declarative Guardrails for AI-Augmented Data Processing Systems 2025 VLDB 4.2942813e-05
10,395 User-Centric Property Graph Repairs 2025 SIGMOD 4.1945683e-05
11,658 Anti-Freeze for Large and Complex Spreadsheets: Asynchronous Formula Computation 2019 SIGMOD 4.1945683e-05
11,707 A Rating-Ranking Method for Crowdsourced Top-k Computation 2018 SIGMOD 4.1945683e-05
11,788 CDB: Optimizing Queries with Crowd-Based Selections and Joins 2017 SIGMOD 4.1945683e-05
11,810 A Confidence-Aware Top-k Query Processing Toolkit on Crowdsourcing 2017 VLDB 4.1945683e-05
11,816 DOCS: Domain-Aware Crowdsourcing System 2017 VLDB 4.1945683e-05
11,902 The Importance of Being Expert: Efficient Max-Finding in Crowdsourcing 2015 SIGMOD 4.1945683e-05
12,113 Mob Data Sourcing 2012 SIGMOD 4.1945683e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 1 of 1 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
119 Answering Queries using Humans, Algorithms and Databases 2011 CIDR 0.0004564788
Previous Page 1 / 1 Next

Semantically Similar Papers

Overall Rank Paper Year Venue Pagerank
11,788 CDB: Optimizing Queries with Crowd-Based Selections and Joins 2017 SIGMOD 4.1945683e-05
7,572 Pushing the Boundaries of Crowd-enabled Databases with Query-driven Schema Expansion 2012 VLDB 4.7075553e-05
4,579 Crowdsourced Top-k Algorithms: An Experimental Evaluation 2016 VLDB 6.070469e-05
2,334 Counting with the Crowd 2013 VLDB 9.0161817e-05
11,720 Crowdsourcing Analytics with CrowdCur 2018 SIGMOD 4.1945683e-05
1,885 CrowdDB: Query Processing with the VLDB Crowd 2011 VLDB 0.0001021098
3,935 CrowdQ: Crowdsourced Query Understanding 2013 CIDR 6.6163464e-05
94 CrowdDB: Answering Queries with Crowdsourcing 2011 SIGMOD 0.00051013264
2,123 Demonstration of Qurk: A Query Processor for Human Operators 2011 SIGMOD 9.4945521e-05
267 Human-powered Sorts and Joins 2012 VLDB 0.00029690405