DBScholar

Back to papers

Crowdsourced Databases: Query Processing with People

Summary: Presents Qurk, a crowdsourced DBMS that exposes humans on MTurk as query operators to perform filtering, sorting, joining, and aggregation via HIT workflows. Analyzes execution and optimization challenges unique to human-in-the-loop queries—cost/latency/accuracy tradeoffs, batching, operator design, and techniques to minimize HITs and improve result quality. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID
161
Venue
CIDR
Year
2011
Pagerank
0.00023261113
Overall Rank
251 | 98.28%
DOI
-

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{marcus_cidr11,
        address = {Amsterdam, Netherlands},
        series = {{CIDR} '11},
        title = {{Crowdsourced Databases: Query Processing with People}},
        booktitle = {Proceedings of the {Conference} on {Innovative} {Data} {Systems} {Research}},
        author = {Marcus, Adam and Wu, Eugene and Karger, David R. and Madden, Samuel and Miller, Robert C.},
        year = {2011}
}

Incoming Citations (Sorted by Pagerank)

Showing 48 of 48 citing papers.

Rank Citing Paper Year Venue Pagerank
90 CrowdDB: Answering Queries with Crowdsourcing 2011 SIGMOD 0.00034951786
196 CrowdER: Crowdsourcing Entity Resolution 2012 VLDB 0.00025780596
265 Human-powered Sorts and Joins 2012 VLDB 0.00022935368
439 Corleone: Hands-Off Crowdsourcing for Entity Matching 2014 SIGMOD 0.00018464913
997 CrowdScreen: Algorithms for Filtering Data with Humans 2012 SIGMOD 0.00012755983
1,270 CDAS: A Crowdsourcing Data Analytics System 2012 VLDB 0.00011388453
1,343 DocETL: Agentic Query Rewriting and Evaluation for Complex Document Processing 2025 VLDB 0.00011095866
1,643 Falcon: Scaling Up Hands-Off Crowdsourced Entity Matching to Build Cloud Services 2017 SIGMOD 0.00010134956
1,910 Counting with the Crowd 2013 VLDB 9.4972788e-05
2,165 Demonstration of Qurk: A Query Processor for Human Operators 2011 SIGMOD 9.0507521e-05
2,559 dbTouch: Analytics at your Fingertips 2013 CIDR 8.4156672e-05
2,789 Crowd Mining 2013 SIGMOD 8.1203892e-05
3,231 Truth Inference in Crowdsourcing: Is the Problem Solved? 2017 VLDB 7.6191767e-05
3,262 iCrowd: An Adaptive Crowdsourcing Framework 2015 SIGMOD 7.5846052e-05
3,904 QASCA: A Quality-Aware Task Assignment System for Crowdsourcing Applications 2015 SIGMOD 7.0304212e-05
3,914 Optimal Crowd-Powered Rating and Filtering Algorithms 2014 VLDB 7.0204052e-05
4,050 Revisiting Prompt Engineering via Declarative Crowdsourcing 2024 CIDR 6.9368666e-05
4,153 Whom to Ask? Jury Selection for Decision Making Tasks on Micro-blog Services 2012 VLDB 6.8676997e-05
4,428 Arnold: Declarative Crowd-Machine Data Integration 2013 CIDR 6.7094035e-05
4,538 Cost-Effective Crowdsourced Entity Resolution: A Partial-Order Approach 2016 SIGMOD 6.6404776e-05
4,944 Hybrid Querying Over Relational Databases and Large Language Models 2025 CIDR 6.432467e-05
5,143 An Online Cost Sensitive Decision-Making Method in Crowdsourcing Systems 2013 SIGMOD 6.3476753e-05
5,211 CDB: A Crowd-Powered Database System 2018 VLDB 6.3161892e-05
5,220 Databases Unbound: Querying All of the World’s Bytes with AI 2024 VLDB 6.3108362e-05
5,343 Crowdsourcing Applications and Platforms: A Data Management Perspective 2011 VLDB 6.259258e-05
5,474 CrowdQ: Crowdsourced Query Understanding 2013 CIDR 6.2054029e-05
5,813 Efficient Algorithms for Crowd-Aided Categorization 2020 VLDB 6.0780519e-05
6,816 Inspector Gadget: A Data Programming-based Labeling System for Industrial Images 2021 VLDB 5.7649828e-05
6,819 Estimating the Impact of Unknown Unknowns on Aggregate Query Results 2016 SIGMOD 5.7635226e-05
6,899 Human-in-the-loop Outlier Detection 2020 SIGMOD 5.7431609e-05
7,018 Answering Planning Queries with the Crowd 2013 VLDB 5.7251004e-05
7,313 Interactive Graph Search 2019 SIGMOD 5.6480084e-05
7,357 Crowdsourced Data Management: Overview and Challenges 2017 SIGMOD 5.6346837e-05
7,493 Human-in-the-loop Data Integration 2017 VLDB 5.6046905e-05
7,630 Pushing the Boundaries of Crowd-enabled Databases with Query-driven Schema Expansion 2012 VLDB 5.5783186e-05
8,788 Managing General and Individual Knowledge in Crowd Mining Applications 2015 CIDR 5.3726124e-05
8,807 Understanding Workers, Developing Effective Tasks, and Enhancing Marketplace Dynamics: A Study of a Large Crowdsourcing Marketplace 2017 VLDB 5.3671183e-05
8,868 SemBench: A Benchmark for Semantic Query Processing Engines 2026 VLDB 5.3546848e-05
9,193 Query-Guided Resolution in Uncertain Databases 2023 SIGMOD 5.3058708e-05
9,401 CDB: Optimizing Queries with Crowd-Based Selections and Joins 2017 SIGMOD 5.2755515e-05
9,841 Semantic Integrity Constraints: Declarative Guardrails for AI-Augmented Data Processing Systems 2025 VLDB 5.2101877e-05
10,681 User-Centric Property Graph Repairs 2025 SIGMOD 5.093636e-05
11,853 Anti-Freeze for Large and Complex Spreadsheets: Asynchronous Formula Computation 2019 SIGMOD 5.093636e-05
11,912 A Rating-Ranking Method for Crowdsourced Top-k Computation 2018 SIGMOD 5.093636e-05
12,013 A Confidence-Aware Top-k Query Processing Toolkit on Crowdsourcing 2017 VLDB 5.093636e-05
12,019 DOCS: Domain-Aware Crowdsourcing System 2017 VLDB 5.093636e-05
12,101 The Importance of Being Expert: Efficient Max-Finding in Crowdsourcing 2015 SIGMOD 5.093636e-05
12,310 Mob Data Sourcing 2012 SIGMOD 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 1 of 1 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
250 Answering Queries using Humans, Algorithms and Databases 2011 CIDR 0.00023261164
Previous Page 1 / 1 Next

Semantically Similar Papers