Counting with the Crowd

Summary: Crowdsourced selectivity estimation for predicates without full scans, leveraging workers to estimate the fraction of items satisfying a property. Counts (showing items) excel for image datasets, while sampled labeling wins on text; a spammer/collusion detector boosts accuracy by up to 100×. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: he4310471f3c0bd9b
Venue: VLDB
Year: 2013
Pagerank: 9.3441665e-05
Overall Rank: 1,932 | 87.06%
DOI: 10.14778/2536222.2536228

Incoming Non-self Citations Over Time

Authors

1. Adam Marcus (Massachusetts Institute of Technology)
2. David Karger (Massachusetts Institute of Technology)
3. Samuel Madden (Massachusetts Institute of Technology)
4. Robert Miller (Massachusetts Institute of Technology)
5. Sewoong Oh (University of Illinois Urbana-Champaign)

BibTeX Citation

@article{marcus_vldb13,
        title = {{Counting with the Crowd}},
        author = {Marcus, Adam and Karger, David and Madden, Samuel and Miller, Robert and Oh, Sewoong},
        journal = {PVLDB},
        series = {{VLDB} '13},
        volume = {6},
        number = {2},
        pages = {109--120},
        doi = {10.14778/2536222.2536228},
        url = {https://doi.org/10.14778/2536222.2536228},
        year = {2013}
}

Incoming Citations (Sorted by Pagerank)

Showing 19 of 19 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,650	Falcon: Scaling Up Hands-Off Crowdsourced Entity Matching to Build Cloud Services	2017	SIGMOD	9.9690948e-05
2,492	Query-Oriented Data Cleaning with Oracles	2015	SIGMOD	8.3722864e-05
2,647	Scaling Up Crowd-Sourcing to Very Large Datasets: A Case for Active Learning	2015	VLDB	8.1565673e-05
3,659	Revisiting Prompt Engineering via Declarative Crowdsourcing	2024	CIDR	7.1094444e-05
3,849	QASCA: A Quality-Aware Task Assignment System for Crowdsourcing Applications	2015	SIGMOD	6.9657571e-05
4,029	CLAMShell: Speeding up Crowds for Low-latency Data Labeling	2016	VLDB	6.8285702e-05
4,996	SemBench: A Benchmark for Semantic Query Processing Engines	2026	VLDB	6.3095672e-05
5,586	Efficient Algorithms for Crowd-Aided Categorization	2020	VLDB	6.0582193e-05
6,404	Human-in-the-loop Data Integration	2017	VLDB	5.7797097e-05
6,518	QOCO: A Query Oriented Data Cleaning System with Oracles	2015	VLDB	5.741664e-05
6,644	Budget Constrained Interactive Search for Multiple Targets	2021	VLDB	5.7057955e-05
6,791	Crowdsourced Data Management: Overview and Challenges	2017	SIGMOD	5.6647309e-05
6,948	Interactive Graph Search	2019	SIGMOD	5.6210529e-05
7,241	OASSIS: Query Driven Crowd Mining	2014	SIGMOD	5.5620382e-05
8,972	Managing General and Individual Knowledge in Crowd Mining Applications	2015	CIDR	5.2347984e-05
9,223	Interactive Graph Search for Multiple Targets on DAGs	2025	VLDB	5.1913816e-05
9,473	Ontology Assisted Crowd Mining	2014	VLDB	5.1582248e-05
9,617	CDB: Optimizing Queries with Crowd-Based Selections and Joins	2017	SIGMOD	5.1376962e-05
12,261	A Rating-Ranking Method for Crowdsourced Top-k Computation	2018	SIGMOD	4.9605343e-05

Outgoing Citations (Sorted by Pagerank)

Showing 6 of 6 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
92	CrowdDB: Answering Queries with Crowdsourcing	2011	SIGMOD	0.00034613457
257	Crowdsourced Databases: Query Processing with People	2011	CIDR	0.00022914527
260	Answering Queries using Humans, Algorithms and Databases	2011	CIDR	0.00022866018
266	Human-powered Sorts and Joins	2012	VLDB	0.00022701006
754	So Who Won? Dynamic Max Discovery with the Crowd	2012	SIGMOD	0.00014226032
991	CrowdScreen: Algorithms for Filtering Data with Humans	2012	SIGMOD	0.00012632003

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	9,617	CDB: Optimizing Queries with Crowd-Based Selections and Joins	2017	SIGMOD
2	58	Statistical Estimators for Relational Algebra Expressions	1988	PODS
3	2,647	Scaling Up Crowd-Sourcing to Very Large Datasets: A Case for Active Learning	2015	VLDB
4	92	CrowdDB: Answering Queries with Crowdsourcing	2011	SIGMOD
5	3,136	Every Row Counts: Combining Sketches and Sampling for Accurate Group-By Result Estimates	2019	CIDR
6	266	Human-powered Sorts and Joins	2012	VLDB
7	5,052	Crowdsourced Top-k Algorithms: An Experimental Evaluation	2016	VLDB
8	991	CrowdScreen: Algorithms for Filtering Data with Humans	2012	SIGMOD
9	257	Crowdsourced Databases: Query Processing with People	2011	CIDR
10	7,175	Learning to Sample: Counting with Complex Queries	2020	VLDB