Database Paper Browser

Back to papers

Crowdsourced Databases: Query Processing with People

Summary: Presents Qurk, a crowdsourced DBMS that exposes humans on MTurk as query operators to perform filtering, sorting, joining, and aggregation via HIT workflows. Analyzes execution and optimization challenges unique to human-in-the-loop queries—cost/latency/accuracy tradeoffs, batching, operator design, and techniques to minimize HITs and improve result quality. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID
161
Venue
CIDR
Year
2011
Pagerank
0.00030952631
Overall Rank
246 | 98.30%
DOI
-

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 48 of 48 citing papers.

Rank Citing Paper Year Venue Pagerank
94 CrowdDB: Answering Queries with Crowdsourcing 2011 SIGMOD 0.00051273089
265 CrowdER: Crowdsourcing Entity Resolution 2012 VLDB 0.00029904018
266 Human-powered Sorts and Joins 2012 VLDB 0.00029884758
641 Corleone: Hands-Off Crowdsourcing for Entity Matching 2014 SIGMOD 0.00018759417
1,154 CrowdScreen: Algorithms for Filtering Data with Humans 2012 SIGMOD 0.00013616867
1,491 CDAS: A Crowdsourcing Data Analytics System 2012 VLDB 0.00011685731
1,839 DocETL: Agentic Query Rewriting and Evaluation for Complex Document Processing 2025 VLDB 0.00010351287
1,845 dbTouch: Analytics at your Fingertips 2013 CIDR 0.00010339281
2,121 Demonstration of Qurk: A Query Processor for Human Operators 2011 SIGMOD 9.4930973e-05
2,176 Falcon: Scaling Up Hands-Off Crowdsourced Entity Matching to Build Cloud Services 2017 SIGMOD 9.3729351e-05
2,255 Counting with the Crowd 2013 VLDB 9.1846281e-05
2,944 Truth Inference in Crowdsourcing: Is the Problem Solved? 2017 VLDB 7.8457167e-05
3,104 Crowd Mining 2013 SIGMOD 7.5577057e-05
3,268 QASCA: A Quality-Aware Task Assignment System for Crowdsourcing Applications 2015 SIGMOD 7.3027561e-05
3,324 iCrowd: An Adaptive Crowdsourcing Framework 2015 SIGMOD 7.2163115e-05
3,803 Revisiting Prompt Engineering via Declarative Crowdsourcing 2024 CIDR 6.7498941e-05
3,939 CrowdQ: Crowdsourced Query Understanding 2013 CIDR 6.6099823e-05
4,181 Arnold: Declarative Crowd-Machine Data Integration 2013 CIDR 6.3725128e-05
4,483 Optimal Crowd-Powered Rating and Filtering Algorithms 2014 VLDB 6.1431599e-05
4,529 Hybrid Querying Over Relational Databases and Large Language Models 2025 CIDR 6.1057096e-05
4,648 Whom to Ask? Jury Selection for Decision Making Tasks on Micro-blog Services 2012 VLDB 6.01726e-05
4,832 An Online Cost Sensitive Decision-Making Method in Crowdsourcing Systems 2013 SIGMOD 5.8883457e-05
5,254 CDB: A Crowd-Powered Database System 2018 VLDB 5.5991922e-05
5,369 Cost-Effective Crowdsourced Entity Resolution: A Partial-Order Approach 2016 SIGMOD 5.5436995e-05
5,458 Crowdsourcing Applications and Platforms: A Data Management Perspective 2011 VLDB 5.4952003e-05
5,669 Databases Unbound: Querying All of the World's Bytes with AI 2024 VLDB 5.3805024e-05
5,744 Efficient Algorithms for Crowd-Aided Categorization 2020 VLDB 5.343155e-05
6,943 Estimating the Impact of Unknown Unknowns on Aggregate Query Results 2016 SIGMOD 4.8876509e-05
6,953 Inspector Gadget: A Data Programming-based Labeling System for Industrial Images 2021 VLDB 4.8817419e-05
7,112 Answering Planning Queries with the Crowd 2013 VLDB 4.8227734e-05
7,116 Crowdsourced Data Management: Overview and Challenges 2017 SIGMOD 4.8219732e-05
7,534 Interactive Graph Search 2019 SIGMOD 4.7133212e-05
7,577 Pushing the Boundaries of Crowd-enabled Databases with Query-driven Schema Expansion 2012 VLDB 4.703047e-05
7,580 Human-in-the-loop Outlier Detection 2020 SIGMOD 4.7023767e-05
7,667 Human-in-the-loop Data Integration 2017 VLDB 4.6791871e-05
8,510 Understanding Workers, Developing Effective Tasks, and Enhancing Marketplace Dynamics: A Study of a Large Crowdsourcing Marketplace 2017 VLDB 4.4904732e-05
8,690 Managing General and Individual Knowledge in Crowd Mining Applications 2015 CIDR 4.4618888e-05
9,043 Query-Guided Resolution in Uncertain Databases 2023 SIGMOD 4.3997447e-05
9,728 Semantic Integrity Constraints: Declarative Guardrails for AI-Augmented Data Processing Systems 2025 VLDB 4.2901665e-05
10,277 SemBench: A Benchmark for Semantic Query Processing Engines 2026 VLDB 4.1905499e-05
10,406 User-Centric Property Graph Repairs 2025 SIGMOD 4.1905499e-05
11,663 Anti-Freeze for Large and Complex Spreadsheets: Asynchronous Formula Computation 2019 SIGMOD 4.1905499e-05
11,713 A Rating-Ranking Method for Crowdsourced Top-k Computation 2018 SIGMOD 4.1905499e-05
11,796 CDB: Optimizing Queries with Crowd-Based Selections and Joins 2017 SIGMOD 4.1905499e-05
11,818 A Confidence-Aware Top-k Query Processing Toolkit on Crowdsourcing 2017 VLDB 4.1905499e-05
11,824 DOCS: Domain-Aware Crowdsourcing System 2017 VLDB 4.1905499e-05
11,910 The Importance of Being Expert: Efficient Max-Finding in Crowdsourcing 2015 SIGMOD 4.1905499e-05
12,121 Mob Data Sourcing 2012 SIGMOD 4.1905499e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 1 of 1 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
118 Answering Queries using Humans, Algorithms and Databases 2011 CIDR 0.00045860394
Previous Page 1 / 1 Next

Semantically Similar Papers

Overall Rank Paper Year Venue Pagerank
11,796 CDB: Optimizing Queries with Crowd-Based Selections and Joins 2017 SIGMOD 4.1905499e-05
7,577 Pushing the Boundaries of Crowd-enabled Databases with Query-driven Schema Expansion 2012 VLDB 4.703047e-05
4,580 Crowdsourced Top-k Algorithms: An Experimental Evaluation 2016 VLDB 6.0646299e-05
2,255 Counting with the Crowd 2013 VLDB 9.1846281e-05
11,726 Crowdsourcing Analytics with CrowdCur 2018 SIGMOD 4.1905499e-05
1,883 CrowdDB: Query Processing with the VLDB Crowd 2011 VLDB 0.00010208032
3,939 CrowdQ: Crowdsourced Query Understanding 2013 CIDR 6.6099823e-05
94 CrowdDB: Answering Queries with Crowdsourcing 2011 SIGMOD 0.00051273089
2,121 Demonstration of Qurk: A Query Processor for Human Operators 2011 SIGMOD 9.4930973e-05
266 Human-powered Sorts and Joins 2012 VLDB 0.00029884758