DBScholar

Back to papers

Crowdsourced Databases: Query Processing with People

Summary: Presents Qurk, a crowdsourced DBMS that exposes humans on MTurk as query operators to perform filtering, sorting, joining, and aggregation via HIT workflows. Analyzes execution and optimization challenges unique to human-in-the-loop queries—cost/latency/accuracy tradeoffs, batching, operator design, and techniques to minimize HITs and improve result quality. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID
h4f9346900ff72c4d
Venue
CIDR
Year
2011
Pagerank
0.00022962347
Overall Rank
257 | 98.28%
DOI
-

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{marcus_cidr11,
        address = {Amsterdam, Netherlands},
        series = {{CIDR} '11},
        title = {{Crowdsourced Databases: Query Processing with People}},
        booktitle = {Proceedings of the {Conference} on {Innovative} {Data} {Systems} {Research}},
        author = {Marcus, Adam and Wu, Eugene and Karger, David R. and Madden, Samuel and Miller, Robert C.},
        year = {2011}
}

Incoming Citations (Sorted by Pagerank)

Showing 48 of 48 citing papers.

Rank Citing Paper Year Venue Pagerank
92 CrowdDB: Answering Queries with Crowdsourcing 2011 SIGMOD 0.00034672523
198 CrowdER: Crowdsourcing Entity Resolution 2012 VLDB 0.00025555196
266 Human-powered Sorts and Joins 2012 VLDB 0.00022739124
433 Corleone: Hands-Off Crowdsourcing for Entity Matching 2014 SIGMOD 0.00018332741
683 DocETL: Agentic Query Rewriting and Evaluation for Complex Document Processing 2025 VLDB 0.00014817539
987 CrowdScreen: Algorithms for Filtering Data with Humans 2012 SIGMOD 0.00012660627
1,264 CDAS: A Crowdsourcing Data Analytics System 2012 VLDB 0.0001128316
1,654 Falcon: Scaling Up Hands-Off Crowdsourced Entity Matching to Build Cloud Services 2017 SIGMOD 9.9739611e-05
1,926 Counting with the Crowd 2013 VLDB 9.3637786e-05
2,192 Demonstration of Qurk: A Query Processor for Human Operators 2011 SIGMOD 8.8821872e-05
2,605 dbTouch: Analytics at your Fingertips 2013 CIDR 8.229938e-05
2,832 Crowd Mining 2013 SIGMOD 7.9590386e-05
3,171 Truth Inference in Crowdsourcing: Is the Problem Solved? 2017 VLDB 7.5691557e-05
3,197 iCrowd: An Adaptive Crowdsourcing Framework 2015 SIGMOD 7.5455503e-05
3,695 Revisiting Prompt Engineering via Declarative Crowdsourcing 2024 CIDR 7.092445e-05
3,838 Optimal Crowd-Powered Rating and Filtering Algorithms 2014 VLDB 6.9929907e-05
3,839 QASCA: A Quality-Aware Task Assignment System for Crowdsourcing Applications 2015 SIGMOD 6.9921604e-05
4,220 Whom to Ask? Jury Selection for Decision Making Tasks on Micro-blog Services 2012 VLDB 6.7252203e-05
4,518 Arnold: Declarative Crowd-Machine Data Integration 2013 CIDR 6.5632796e-05
4,557 Databases Unbound: Querying All of the World’s Bytes with AI 2024 VLDB 6.5356905e-05
4,623 Cost-Effective Crowdsourced Entity Resolution: A Partial-Order Approach 2016 SIGMOD 6.4978811e-05
4,787 Hybrid Querying Over Relational Databases and Large Language Models 2025 CIDR 6.4143303e-05
5,061 CDB: A Crowd-Powered Database System 2018 VLDB 6.2912543e-05
5,250 An Online Cost Sensitive Decision-Making Method in Crowdsourcing Systems 2013 SIGMOD 6.2097153e-05
5,466 Crowdsourcing Applications and Platforms: A Data Management Perspective 2011 VLDB 6.1202777e-05
5,501 SemBench: A Benchmark for Semantic Query Processing Engines 2026 VLDB 6.1027188e-05
5,570 Efficient Algorithms for Crowd-Aided Categorization 2020 VLDB 6.0811968e-05
5,614 CrowdQ: Crowdsourced Query Understanding 2013 CIDR 6.066925e-05
6,397 Human-in-the-loop Data Integration 2017 VLDB 5.7989499e-05
6,880 Estimating the Impact of Unknown Unknowns on Aggregate Query Results 2016 SIGMOD 5.6573214e-05
6,925 Interactive Graph Search 2019 SIGMOD 5.6423723e-05
6,937 Inspector Gadget: A Data Programming-based Labeling System for Industrial Images 2021 VLDB 5.6397218e-05
7,042 Human-in-the-loop Outlier Detection 2020 SIGMOD 5.6142998e-05
7,089 Answering Planning Queries with the Crowd 2013 VLDB 5.6018191e-05
7,500 Crowdsourced Data Management: Overview and Challenges 2017 SIGMOD 5.5083793e-05
7,782 Pushing the Boundaries of Crowd-enabled Databases with Query-driven Schema Expansion 2012 VLDB 5.4535412e-05
7,885 Semantic Integrity Constraints: Declarative Guardrails for AI-Augmented Data Processing Systems 2025 VLDB 5.433531e-05
8,951 Managing General and Individual Knowledge in Crowd Mining Applications 2015 CIDR 5.252096e-05
8,955 Understanding Workers, Developing Effective Tasks, and Enhancing Marketplace Dynamics: A Study of a Large Crowdsourcing Marketplace 2017 VLDB 5.2510657e-05
9,373 Query-Guided Resolution in Uncertain Databases 2023 SIGMOD 5.1868213e-05
9,583 CDB: Optimizing Queries with Crowd-Based Selections and Joins 2017 SIGMOD 5.1571823e-05
11,121 User-Centric Property Graph Repairs 2025 SIGMOD 4.9793485e-05
12,153 Anti-Freeze for Large and Complex Spreadsheets: Asynchronous Formula Computation 2019 SIGMOD 4.9793485e-05
12,212 A Rating-Ranking Method for Crowdsourced Top-k Computation 2018 SIGMOD 4.9793485e-05
12,308 A Confidence-Aware Top-k Query Processing Toolkit on Crowdsourcing 2017 VLDB 4.9793485e-05
12,314 DOCS: Domain-Aware Crowdsourcing System 2017 VLDB 4.9793485e-05
12,394 The Importance of Being Expert: Efficient Max-Finding in Crowdsourcing 2015 SIGMOD 4.9793485e-05
12,601 Mob Data Sourcing 2012 SIGMOD 4.9793485e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 1 of 1 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
259 Answering Queries using Humans, Algorithms and Databases 2011 CIDR 0.00022923243
Previous Page 1 / 1 Next

Semantically Similar Papers