DBScholar

Back to papers

Crowdsourced Databases: Query Processing with People

Summary: Presents Qurk, a crowdsourced DBMS that exposes humans on MTurk as query operators to perform filtering, sorting, joining, and aggregation via HIT workflows. Analyzes execution and optimization challenges unique to human-in-the-loop queries—cost/latency/accuracy tradeoffs, batching, operator design, and techniques to minimize HITs and improve result quality. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID
h4f9346900ff72c4d
Venue
CIDR
Year
2011
Pagerank
0.00022958404
Overall Rank
257 | 98.28%
DOI
-
PDF
Download (CC BY 3.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{marcus_cidr11,
        address = {Amsterdam, Netherlands},
        series = {{CIDR} '11},
        title = {{Crowdsourced Databases: Query Processing with People}},
        booktitle = {Proceedings of the {Conference} on {Innovative} {Data} {Systems} {Research}},
        author = {Marcus, Adam and Wu, Eugene and Karger, David R. and Madden, Samuel and Miller, Robert C.},
        year = {2011}
}

Incoming Citations (Sorted by Pagerank)

Showing 48 of 48 citing papers.

Rank Citing Paper Year Venue Pagerank
92 CrowdDB: Answering Queries with Crowdsourcing 2011 SIGMOD 0.00034670735
198 CrowdER: Crowdsourcing Entity Resolution 2012 VLDB 0.00025546182
266 Human-powered Sorts and Joins 2012 VLDB 0.00022735106
433 Corleone: Hands-Off Crowdsourcing for Entity Matching 2014 SIGMOD 0.00018324965
658 DocETL: Agentic Query Rewriting and Evaluation for Complex Document Processing 2025 VLDB 0.00015058738
987 CrowdScreen: Algorithms for Filtering Data with Humans 2012 SIGMOD 0.00012655094
1,265 CDAS: A Crowdsourcing Data Analytics System 2012 VLDB 0.00011277921
1,655 Falcon: Scaling Up Hands-Off Crowdsourced Entity Matching to Build Cloud Services 2017 SIGMOD 9.9694129e-05
1,926 Counting with the Crowd 2013 VLDB 9.3636304e-05
2,194 Demonstration of Qurk: A Query Processor for Human Operators 2011 SIGMOD 8.8780295e-05
2,607 dbTouch: Analytics at your Fingertips 2013 CIDR 8.2260445e-05
2,832 Crowd Mining 2013 SIGMOD 7.9554419e-05
3,173 Truth Inference in Crowdsourcing: Is the Problem Solved? 2017 VLDB 7.5655739e-05
3,199 iCrowd: An Adaptive Crowdsourcing Framework 2015 SIGMOD 7.5419863e-05
3,668 Revisiting Prompt Engineering via Declarative Crowdsourcing 2024 CIDR 7.1144218e-05
3,839 Optimal Crowd-Powered Rating and Filtering Algorithms 2014 VLDB 6.9896853e-05
3,840 QASCA: A Quality-Aware Task Assignment System for Crowdsourcing Applications 2015 SIGMOD 6.988858e-05
4,220 Whom to Ask? Jury Selection for Decision Making Tasks on Micro-blog Services 2012 VLDB 6.7220383e-05
4,519 Arnold: Declarative Crowd-Machine Data Integration 2013 CIDR 6.5602428e-05
4,558 Databases Unbound: Querying All of the World’s Bytes with AI 2024 VLDB 6.5333125e-05
4,625 Cost-Effective Crowdsourced Entity Resolution: A Partial-Order Approach 2016 SIGMOD 6.4948389e-05
4,789 Hybrid Querying Over Relational Databases and Large Language Models 2025 CIDR 6.4117376e-05
5,050 CDB: A Crowd-Powered Database System 2018 VLDB 6.2955765e-05
5,253 An Online Cost Sensitive Decision-Making Method in Crowdsourcing Systems 2013 SIGMOD 6.206776e-05
5,309 SemBench: A Benchmark for Semantic Query Processing Engines 2026 VLDB 6.1841176e-05
5,470 Crowdsourcing Applications and Platforms: A Data Management Perspective 2011 VLDB 6.1173893e-05
5,572 Efficient Algorithms for Crowd-Aided Categorization 2020 VLDB 6.078318e-05
5,615 CrowdQ: Crowdsourced Query Understanding 2013 CIDR 6.0640551e-05
6,400 Human-in-the-loop Data Integration 2017 VLDB 5.7962311e-05
6,885 Estimating the Impact of Unknown Unknowns on Aggregate Query Results 2016 SIGMOD 5.6546466e-05
6,928 Interactive Graph Search 2019 SIGMOD 5.6397012e-05
6,940 Inspector Gadget: A Data Programming-based Labeling System for Industrial Images 2021 VLDB 5.637052e-05
7,043 Human-in-the-loop Outlier Detection 2020 SIGMOD 5.611642e-05
7,091 Answering Planning Queries with the Crowd 2013 VLDB 5.5991673e-05
7,505 Crowdsourced Data Management: Overview and Challenges 2017 SIGMOD 5.5057737e-05
7,789 Pushing the Boundaries of Crowd-enabled Databases with Query-driven Schema Expansion 2012 VLDB 5.4509595e-05
7,865 Semantic Integrity Constraints: Declarative Guardrails for AI-Augmented Data Processing Systems 2025 VLDB 5.4361737e-05
8,959 Managing General and Individual Knowledge in Crowd Mining Applications 2015 CIDR 5.2496174e-05
8,963 Understanding Workers, Developing Effective Tasks, and Enhancing Marketplace Dynamics: A Study of a Large Crowdsourcing Marketplace 2017 VLDB 5.2486059e-05
9,382 Query-Guided Resolution in Uncertain Databases 2023 SIGMOD 5.1843659e-05
9,591 CDB: Optimizing Queries with Crowd-Based Selections and Joins 2017 SIGMOD 5.154741e-05
11,130 User-Centric Property Graph Repairs 2025 SIGMOD 4.9769913e-05
12,159 Anti-Freeze for Large and Complex Spreadsheets: Asynchronous Formula Computation 2019 SIGMOD 4.9769913e-05
12,218 A Rating-Ranking Method for Crowdsourced Top-k Computation 2018 SIGMOD 4.9769913e-05
12,314 A Confidence-Aware Top-k Query Processing Toolkit on Crowdsourcing 2017 VLDB 4.9769913e-05
12,320 DOCS: Domain-Aware Crowdsourcing System 2017 VLDB 4.9769913e-05
12,400 The Importance of Being Expert: Efficient Max-Finding in Crowdsourcing 2015 SIGMOD 4.9769913e-05
12,607 Mob Data Sourcing 2012 SIGMOD 4.9769913e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 1 of 1 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
259 Answering Queries using Humans, Algorithms and Databases 2011 CIDR 0.00022916014
Previous Page 1 / 1 Next

Semantically Similar Papers