Counting with the Crowd

Summary: Crowdsourced selectivity estimation for predicates without full scans, leveraging workers to estimate the fraction of items satisfying a property. Counts (showing items) excel for image datasets, while sampled labeling wins on text; a spammer/collusion detector boosts accuracy by up to 100×. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: he4310471f3c0bd9b
Venue: VLDB
Year: 2013
Pagerank: 9.3637786e-05
Overall Rank: 1,926 | 87.06%
DOI: 10.14778/2536222.2536228

Incoming Non-self Citations Over Time

Authors

1. Adam Marcus (Massachusetts Institute of Technology)
2. David Karger (Massachusetts Institute of Technology)
3. Samuel Madden (Massachusetts Institute of Technology)
4. Robert Miller (Massachusetts Institute of Technology)
5. Sewoong Oh (University of Illinois Urbana-Champaign)

BibTeX Citation

@article{marcus_vldb13,
        title = {{Counting with the Crowd}},
        author = {Marcus, Adam and Karger, David and Madden, Samuel and Miller, Robert and Oh, Sewoong},
        journal = {PVLDB},
        series = {{VLDB} '13},
        volume = {6},
        number = {2},
        pages = {109--120},
        doi = {10.14778/2536222.2536228},
        url = {https://doi.org/10.14778/2536222.2536228},
        year = {2013}
}

Incoming Citations (Sorted by Pagerank)

Showing 19 of 19 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,654	Falcon: Scaling Up Hands-Off Crowdsourced Entity Matching to Build Cloud Services	2017	SIGMOD	9.9739611e-05
2,504	Query-Oriented Data Cleaning with Oracles	2015	SIGMOD	8.3782213e-05
2,642	Scaling Up Crowd-Sourcing to Very Large Datasets: A Case for Active Learning	2015	VLDB	8.1778168e-05
3,695	Revisiting Prompt Engineering via Declarative Crowdsourcing	2024	CIDR	7.092445e-05
3,839	QASCA: A Quality-Aware Task Assignment System for Crowdsourcing Applications	2015	SIGMOD	6.9921604e-05
4,024	CLAMShell: Speeding up Crowds for Low-latency Data Labeling	2016	VLDB	6.8472018e-05
5,501	SemBench: A Benchmark for Semantic Query Processing Engines	2026	VLDB	6.1027188e-05
5,570	Efficient Algorithms for Crowd-Aided Categorization	2020	VLDB	6.0811968e-05
6,397	Human-in-the-loop Data Integration	2017	VLDB	5.7989499e-05
6,537	QOCO: A Query Oriented Data Cleaning System with Oracles	2015	VLDB	5.7535125e-05
6,629	Budget Constrained Interactive Search for Multiple Targets	2021	VLDB	5.7274363e-05
6,925	Interactive Graph Search	2019	SIGMOD	5.6423723e-05
7,228	OASSIS: Query Driven Crowd Mining	2014	SIGMOD	5.5805857e-05
7,500	Crowdsourced Data Management: Overview and Challenges	2017	SIGMOD	5.5083793e-05
8,951	Managing General and Individual Knowledge in Crowd Mining Applications	2015	CIDR	5.252096e-05
9,191	Interactive Graph Search for Multiple Targets on DAGs	2025	VLDB	5.2110714e-05
9,450	Ontology Assisted Crowd Mining	2014	VLDB	5.1752483e-05
9,583	CDB: Optimizing Queries with Crowd-Based Selections and Joins	2017	SIGMOD	5.1571823e-05
12,212	A Rating-Ranking Method for Crowdsourced Top-k Computation	2018	SIGMOD	4.9793485e-05

Outgoing Citations (Sorted by Pagerank)

Showing 6 of 6 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
92	CrowdDB: Answering Queries with Crowdsourcing	2011	SIGMOD	0.00034672523
257	Crowdsourced Databases: Query Processing with People	2011	CIDR	0.00022962347
259	Answering Queries using Humans, Algorithms and Databases	2011	CIDR	0.00022923243
266	Human-powered Sorts and Joins	2012	VLDB	0.00022739124
749	So Who Won? Dynamic Max Discovery with the Crowd	2012	SIGMOD	0.00014265279
987	CrowdScreen: Algorithms for Filtering Data with Humans	2012	SIGMOD	0.00012660627

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	9,583	CDB: Optimizing Queries with Crowd-Based Selections and Joins	2017	SIGMOD
2	58	Statistical Estimators for Relational Algebra Expressions	1988	PODS
3	2,642	Scaling Up Crowd-Sourcing to Very Large Datasets: A Case for Active Learning	2015	VLDB
4	92	CrowdDB: Answering Queries with Crowdsourcing	2011	SIGMOD
5	3,131	Every Row Counts: Combining Sketches and Sampling for Accurate Group-By Result Estimates	2019	CIDR
6	266	Human-powered Sorts and Joins	2012	VLDB
7	5,024	Crowdsourced Top-k Algorithms: An Experimental Evaluation	2016	VLDB
8	987	CrowdScreen: Algorithms for Filtering Data with Humans	2012	SIGMOD
9	257	Crowdsourced Databases: Query Processing with People	2011	CIDR
10	7,166	Learning to Sample: Counting with Complex Queries	2020	VLDB