Answering Queries using Humans, Algorithms and Databases

Summary: Presents a declarative language combining human-computable functions, relational operators, and algorithms, letting the system manage task issuance, answer reconciliation, and DB integration. Analyzes optimization under human-in-the-loop tradeoffs (cost, latency, uncertainty) and methods to fuse human and algorithmic evidence. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: h239caf6dd44aae4d
Venue: CIDR
Year: 2011
Pagerank: 0.00022866018
Overall Rank: 260 | 98.26%
DOI: -
PDF: Download (CC BY 3.0)

Incoming Non-self Citations Over Time

Authors

1. Aditya Parameswaran (Stanford University)
2. Neoklis Polyzotis (University of California Santa Cruz)

BibTeX Citation

@inproceedings{parameswaran_cidr11,
        address = {Amsterdam, Netherlands},
        series = {{CIDR} '11},
        title = {{Answering Queries using Humans, Algorithms and Databases}},
        booktitle = {Proceedings of the {Conference} on {Innovative} {Data} {Systems} {Research}},
        author = {Parameswaran, Aditya and Polyzotis, Neoklis},
        year = {2011}
}

Incoming Citations (Sorted by Pagerank)

Showing 26 of 26 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
92	CrowdDB: Answering Queries with Crowdsourcing	2011	SIGMOD	0.00034613457
257	Crowdsourced Databases: Query Processing with People	2011	CIDR	0.00022914527
266	Human-powered Sorts and Joins	2012	VLDB	0.00022701006
788	Human-Assisted Graph Search: It’s Okay to Ask Questions	2011	VLDB	0.00013946699
989	Data Cleaning: Overview and Emerging Challenges	2016	SIGMOD	0.00012638176
991	CrowdScreen: Algorithms for Filtering Data with Humans	2012	SIGMOD	0.00012632003
1,267	CDAS: A Crowdsourcing Data Analytics System	2012	VLDB	0.00011253716
1,650	Falcon: Scaling Up Hands-Off Crowdsourced Entity Matching to Build Cloud Services	2017	SIGMOD	9.9690948e-05
1,932	Counting with the Crowd	2013	VLDB	9.3441665e-05
2,205	Demonstration of Qurk: A Query Processor for Human Operators	2011	SIGMOD	8.8525313e-05
2,650	CrowdFill: Collecting Structured Data from the Crowd	2014	SIGMOD	8.1519618e-05
2,842	Crowd Mining	2013	SIGMOD	7.9345347e-05
3,210	iCrowd: An Adaptive Crowdsourcing Framework	2015	SIGMOD	7.5170875e-05
3,368	Finish Them!: Pricing Algorithms for Human Computation	2014	VLDB	7.351092e-05
4,613	Reducing Uncertainty of Schema Matching via Crowdsourcing	2013	VLDB	6.4858366e-05
4,812	Hybrid Querying Over Relational Databases and Large Language Models	2025	CIDR	6.3907046e-05
5,276	An Online Cost Sensitive Decision-Making Method in Crowdsourcing Systems	2013	SIGMOD	6.1866921e-05
5,478	Crowdsourcing Applications and Platforms: A Data Management Perspective	2011	VLDB	6.0999674e-05
5,892	CyLog/Crowd4U: A Declarative Platform for Complex Data-centric Crowdsourcing	2012	VLDB	5.9396524e-05
6,235	GenEdit: Compounding Operators and Continuous Improvement to Tackle Text-to-SQL in the Enterprise	2025	CIDR	5.8248698e-05
6,881	Estimating the Impact of Unknown Unknowns on Aggregate Query Results	2016	SIGMOD	5.6415853e-05
7,113	Answering Planning Queries with the Crowd	2013	VLDB	5.5807503e-05
7,396	Hear the Whole Story: Towards the Diversity of Opinion in Crowdsourcing Markets	2015	VLDB	5.5198102e-05
7,805	Pushing the Boundaries of Crowd-enabled Databases with Query-driven Schema Expansion	2012	VLDB	5.4329573e-05
8,090	Where To: Crowd-Aided Path Selection	2014	VLDB	5.3745898e-05
8,973	CrowdMiner: Mining association rules from the crowd	2013	VLDB	5.2347984e-05

Outgoing Citations (Sorted by Pagerank)

Showing 10 of 10 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
9	Online Aggregation	1997	SIGMOD	0.00076079812
125	Predicate Migration: Optimizing Queries with Expensive Predicates	1993	SIGMOD	0.00030398363
127	Trio: A System for Integrated Management of Data, Accuracy, and Lineage	2005	CIDR	0.00030337791
691	Query Optimization in the Presence of Foreign Functions	1993	VLDB	0.00014701803
699	MYSTIQ: A system for finding more answers by using probabilities	2005	SIGMOD	0.00014645232
788	Human-Assisted Graph Search: It’s Okay to Ask Questions	2011	VLDB	0.00013946699
816	An Interactive Clustering-based Approach to Integrating Source Query Interfaces on the Deep Web	2004	SIGMOD	0.00013671567
890	Pay-as-you-go User Feedback for Dataspace Systems	2008	SIGMOD	0.00013212032
974	On the Representation and Querying of Sets of Possible Worlds	1987	SIGMOD	0.0001272688
3,924	Efficiently Incorporating User Feedback into Information Extraction and Integration Programs	2009	SIGMOD	6.9044317e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	1,054	Data-Driven Understanding and Refinement of Schema Mappings	2001	SIGMOD
2	9,408	Query-Guided Resolution in Uncertain Databases	2023	SIGMOD
3	2,549	From Complete to Incomplete Information and Back	2007	SIGMOD
4	672	A Formal Approach to Finding Explanations for Database Queries	2014	SIGMOD
5	178	Constructing an Interactive Natural Language Interface for Relational Databases	2015	VLDB
6	4,559	Databases Unbound: Querying All of the World’s Bytes with AI	2024	VLDB
7	4,598	Entangled Queries: Enabling Declarative Data-Driven Coordination	2011	SIGMOD
8	2,554	Querying Database Knowledge	1990	SIGMOD
9	1,166	A Case for A Collaborative Query Management System	2009	CIDR
10	13,377	Investigation of Algebraic Query Optimisation for Database Programming Languages	1994	VLDB