Answering Queries using Humans, Algorithms and Databases

Summary: Presents a declarative language combining human-computable functions, relational operators, and algorithms, letting the system manage task issuance, answer reconciliation, and DB integration. Analyzes optimization under human-in-the-loop tradeoffs (cost, latency, uncertainty) and methods to fuse human and algorithmic evidence. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: h239caf6dd44aae4d
Venue: CIDR
Year: 2011
Pagerank: 0.00022916014
Overall Rank: 259 | 98.27%
DOI: -
PDF: Download (CC BY 3.0)

Incoming Non-self Citations Over Time

Authors

1. Aditya Parameswaran (Stanford University)
2. Neoklis Polyzotis (University of California Santa Cruz)

BibTeX Citation

@inproceedings{parameswaran_cidr11,
        address = {Amsterdam, Netherlands},
        series = {{CIDR} '11},
        title = {{Answering Queries using Humans, Algorithms and Databases}},
        booktitle = {Proceedings of the {Conference} on {Innovative} {Data} {Systems} {Research}},
        author = {Parameswaran, Aditya and Polyzotis, Neoklis},
        year = {2011}
}

Incoming Citations (Sorted by Pagerank)

Showing 26 of 26 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
92	CrowdDB: Answering Queries with Crowdsourcing	2011	SIGMOD	0.00034670735
257	Crowdsourced Databases: Query Processing with People	2011	CIDR	0.00022958404
266	Human-powered Sorts and Joins	2012	VLDB	0.00022735106
787	Human-Assisted Graph Search: It’s Okay to Ask Questions	2011	VLDB	0.00013982951
987	CrowdScreen: Algorithms for Filtering Data with Humans	2012	SIGMOD	0.00012655094
1,044	Data Cleaning: Overview and Emerging Challenges	2016	SIGMOD	0.00012329478
1,265	CDAS: A Crowdsourcing Data Analytics System	2012	VLDB	0.00011277921
1,655	Falcon: Scaling Up Hands-Off Crowdsourced Entity Matching to Build Cloud Services	2017	SIGMOD	9.9694129e-05
1,926	Counting with the Crowd	2013	VLDB	9.3636304e-05
2,194	Demonstration of Qurk: A Query Processor for Human Operators	2011	SIGMOD	8.8780295e-05
2,653	CrowdFill: Collecting Structured Data from the Crowd	2014	SIGMOD	8.1693619e-05
2,832	Crowd Mining	2013	SIGMOD	7.9554419e-05
3,199	iCrowd: An Adaptive Crowdsourcing Framework	2015	SIGMOD	7.5419863e-05
3,372	Finish Them!: Pricing Algorithms for Human Computation	2014	VLDB	7.3658309e-05
4,604	Reducing Uncertainty of Schema Matching via Crowdsourcing	2013	VLDB	6.504145e-05
4,789	Hybrid Querying Over Relational Databases and Large Language Models	2025	CIDR	6.4117376e-05
5,253	An Online Cost Sensitive Decision-Making Method in Crowdsourcing Systems	2013	SIGMOD	6.206776e-05
5,470	Crowdsourcing Applications and Platforms: A Data Management Perspective	2011	VLDB	6.1173893e-05
5,878	CyLog/Crowd4U: A Declarative Platform for Complex Data-centric Crowdsourcing	2012	VLDB	5.95932e-05
6,224	GenEdit: Compounding Operators and Continuous Improvement to Tackle Text-to-SQL in the Enterprise	2025	CIDR	5.8441943e-05
6,885	Estimating the Impact of Unknown Unknowns on Aggregate Query Results	2016	SIGMOD	5.6546466e-05
7,091	Answering Planning Queries with the Crowd	2013	VLDB	5.5991673e-05
7,377	Hear the Whole Story: Towards the Diversity of Opinion in Crowdsourcing Markets	2015	VLDB	5.5381227e-05
7,789	Pushing the Boundaries of Crowd-enabled Databases with Query-driven Schema Expansion	2012	VLDB	5.4509595e-05
8,144	Where To: Crowd-Aided Path Selection	2014	VLDB	5.3898812e-05
8,960	CrowdMiner: Mining association rules from the crowd	2013	VLDB	5.2496174e-05

Outgoing Citations (Sorted by Pagerank)

Showing 10 of 10 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
9	Online Aggregation	1997	SIGMOD	0.00076265429
125	Predicate Migration: Optimizing Queries with Expensive Predicates	1993	SIGMOD	0.00030462671
126	Trio: A System for Integrated Management of Data, Accuracy, and Lineage	2005	CIDR	0.00030430114
689	Query Optimization in the Presence of Foreign Functions	1993	VLDB	0.00014746059
696	MYSTIQ: A system for finding more answers by using probabilities	2005	SIGMOD	0.00014691377
787	Human-Assisted Graph Search: It’s Okay to Ask Questions	2011	VLDB	0.00013982951
815	An Interactive Clustering-based Approach to Integrating Source Query Interfaces on the Deep Web	2004	SIGMOD	0.00013713173
888	Pay-as-you-go User Feedback for Dataspace Systems	2008	SIGMOD	0.00013250185
971	On the Representation and Querying of Sets of Possible Worlds	1987	SIGMOD	0.00012766663
3,916	Efficiently Incorporating User Feedback into Information Extraction and Integration Programs	2009	SIGMOD	6.9259328e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	1,050	Data-Driven Understanding and Refinement of Schema Mappings	2001	SIGMOD
2	9,382	Query-Guided Resolution in Uncertain Databases	2023	SIGMOD
3	2,543	From Complete to Incomplete Information and Back	2007	SIGMOD
4	671	A Formal Approach to Finding Explanations for Database Queries	2014	SIGMOD
5	180	Constructing an Interactive Natural Language Interface for Relational Databases	2015	VLDB
6	4,558	Databases Unbound: Querying All of the World’s Bytes with AI	2024	VLDB
7	4,581	Entangled Queries: Enabling Declarative Data-Driven Coordination	2011	SIGMOD
8	2,548	Querying Database Knowledge	1990	SIGMOD
9	1,164	A Case for A Collaborative Query Management System	2009	CIDR
10	13,336	Investigation of Algebraic Query Optimisation for Database Programming Languages	1994	VLDB