Database Paper Browser

Back to papers

Scaling Up Crowd-Sourcing to Very Large Datasets: A Case for Active Learning

Summary: Scalable active-learning for crowd-sourced databases, combining ML with human labeling via nonparametric bootstrap. MTurk and 15 datasets show 1–2 orders of magnitude fewer questions than baselines and 4.5–44× faster than prior AL. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
11004
Venue
VLDB
Year
2015
Pagerank
7.6987905e-05
Overall Rank
3,020 | 79.02%
DOI
-

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 18 of 18 citing papers.

Rank Citing Paper Year Venue Pagerank
788 ActiveClean: Interactive Data Cleaning For Statistical Modeling 2016 VLDB 0.00016618698
1,161 VerdictDB: Universalizing Approximate Query Processing 2018 SIGMOD 0.00013579831
1,629 Data Cleaning: Overview and Emerging Challenges 2016 SIGMOD 0.00011073148
2,176 Falcon: Scaling Up Hands-Off Crowdsourced Entity Matching to Build Cloud Services 2017 SIGMOD 9.3729351e-05
2,758 A Comprehensive Benchmark Framework for Active Learning Methods in Entity Matching 2020 SIGMOD 8.1668285e-05
3,144 Active Learning for ML Enhanced Database Systems 2020 SIGMOD 7.4844943e-05
3,767 Cleaning Crowdsourced Labels Using Oracles for Statistical Classification 2019 VLDB 6.7748725e-05
4,453 CLAMShell: Speeding up Crowds for Low-latency Data Labeling 2016 VLDB 6.1690121e-05
5,034 Deep Indexed Active Learning for Matching Heterogeneous Entity Representations 2022 VLDB 5.741974e-05
5,900 In Search of an Entity Resolution OASIS: Optimal Asymptotic Sequential Importance Sampling 2017 VLDB 5.2797112e-05
7,116 Crowdsourced Data Management: Overview and Challenges 2017 SIGMOD 4.8219732e-05
7,647 User Guidance for Efficient Fact Checking 2019 VLDB 4.6844821e-05
9,462 The Battleship Approach to the Low Resource Entity Matching Problem 2023 SIGMOD 4.3324933e-05
9,895 Towards Interpretable and Learnable Risk Analysis for Entity Resolution 2020 SIGMOD 4.2559233e-05
10,279 ALER: An Active Learning Hybrid System for Efficient Entity Resolution 2026 VLDB 4.1905499e-05
11,232 VersaMatch: Ontology Matching with Weak Supervision 2023 VLDB 4.1905499e-05
11,597 Recommending Deployment Strategies for Collaborative Tasks 2020 SIGMOD 4.1905499e-05
11,778 Staging User Feedback toward Rapid Conflict Resolution in Data Fusion 2017 SIGMOD 4.1905499e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 8 of 8 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
94 CrowdDB: Answering Queries with Crowdsourcing 2011 SIGMOD 0.00051273089
265 CrowdER: Crowdsourcing Entity Resolution 2012 VLDB 0.00029904018
266 Human-powered Sorts and Joins 2012 VLDB 0.00029884758
507 On Active Learning of Record Matching Packages 2010 SIGMOD 0.00021474096
1,154 CrowdScreen: Algorithms for Filtering Data with Humans 2012 SIGMOD 0.00013616867
2,255 Counting with the Crowd 2013 VLDB 9.1846281e-05
2,424 The Analytical Bootstrap: a New Method for Fast Error Estimation in Approximate Query Processing 2014 SIGMOD 8.8415494e-05
5,867 ABS: a System for Scalable Approximate Queries with Accuracy Guarantees 2014 SIGMOD 5.2933639e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

Overall Rank Paper Year Venue Pagerank
8,358 Minimizing Efforts in Validating Crowd Answers 2015 SIGMOD 4.5324924e-05
1,842 Crowdsourcing Algorithms for Entity Resolution 2014 VLDB 0.00010342022
7,116 Crowdsourced Data Management: Overview and Challenges 2017 SIGMOD 4.8219732e-05
4,580 Crowdsourced Top-k Algorithms: An Experimental Evaluation 2016 VLDB 6.0646299e-05
6,873 Cost-Effective Data Annotation using Game-Based Crowdsourcing 2019 VLDB 4.8963037e-05
1,491 CDAS: A Crowdsourcing Data Analytics System 2012 VLDB 0.00011685731
8,337 CrowdGame: A Game-Based Crowdsourcing System for Cost-Effective Data Labeling 2019 SIGMOD 4.5385651e-05
1,242 Question Selection for Crowd Entity Resolution 2013 VLDB 0.00013088272
5,744 Efficient Algorithms for Crowd-Aided Categorization 2020 VLDB 5.343155e-05
4,832 An Online Cost Sensitive Decision-Making Method in Crowdsourcing Systems 2013 SIGMOD 5.8883457e-05