Argonaut: Macrotask Crowdsourcing for Complex Data Processing

Summary: Argonaut automates macrotask crowdsourcing for complex data tasks, with hierarchical reviews and predictive quality models to optimize depth. Deployment in a large structured-data pipeline shows up to 118% more errors detected than random spot-checks. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 11230
Venue: VLDB
Year: 2015
Pagerank: 6.3201995e-05
Overall Rank: 5,201 | 64.32%
DOI: 10.14778/2824032.2824062

Incoming Non-self Citations Over Time

Authors

1. Daniel Haas (University of California Berkeley)
2. Jason Ansel (GoDaddy)
3. Lydia Gu (GoDaddy)
4. Adam Marcus (Unlimited Labs)

BibTeX Citation

@article{haas_vldb15,
        title = {{Argonaut: Macrotask Crowdsourcing for Complex Data Processing}},
        author = {Haas, Daniel and Ansel, Jason and Gu, Lydia and Marcus, Adam},
        journal = {PVLDB},
        series = {{VLDB} '15},
        volume = {8},
        number = {12},
        pages = {1642--1653},
        doi = {10.14778/2824032.2824062},
        url = {https://doi.org/10.14778/2824032.2824062},
        year = {2015}
}

Incoming Citations (Sorted by Pagerank)

Showing 3 of 3 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
7,357	Crowdsourced Data Management: Overview and Challenges	2017	SIGMOD	5.6346837e-05
11,882	The Ever Evolving Online Labor Market: Overview, Challenges and Opportunities	2019	VLDB	5.093636e-05
12,068	Collaborative Crowdsourcing with Crowd4U	2016	VLDB	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 9 of 9 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
90	CrowdDB: Answering Queries with Crowdsourcing	2011	SIGMOD	0.00034951786
196	CrowdER: Crowdsourcing Entity Resolution	2012	VLDB	0.00025780596
265	Human-powered Sorts and Joins	2012	VLDB	0.00022935368
439	Corleone: Hands-Off Crowdsourcing for Entity Matching	2014	SIGMOD	0.00018464913
516	Data Curation at Scale: The Data Tamer System	2013	CIDR	0.00017171198
528	On Active Learning of Record Matching Packages	2010	SIGMOD	0.00017100838
588	Extracting Structured Data from Web Pages	2003	SIGMOD	0.00016092668
933	Question Selection for Crowd Entity Resolution	2013	VLDB	0.00013111293
2,636	CrowdFill: Collecting Structured Data from the Crowd	2014	SIGMOD	8.31868e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	11,995	CrowdDQS: Dynamic Question Selection in Crowdsourcing Systems	2017	SIGMOD
2	6,908	Cost-Effective Data Annotation using Game-Based Crowdsourcing	2019	VLDB
3	265	Human-powered Sorts and Joins	2012	VLDB
4	5,474	CrowdQ: Crowdsourced Query Understanding	2013	CIDR
5	4,428	Arnold: Declarative Crowd-Machine Data Integration	2013	CIDR
6	4,568	CrowdMatcher: Crowd-Assisted Schema Matching	2014	SIGMOD
7	90	CrowdDB: Answering Queries with Crowdsourcing	2011	SIGMOD
8	12,068	Collaborative Crowdsourcing with Crowd4U	2016	VLDB
9	251	Crowdsourced Databases: Query Processing with People	2011	CIDR
10	3,262	iCrowd: An Adaptive Crowdsourcing Framework	2015	SIGMOD