DBScholar

Back to papers

Efficient Parallel Set-Similarity Joins Using MapReduce

Summary: 3-stage end-to-end parallel set-similarity joins on MapReduce. Balanced partitioning with minimal replication, memory-aware processing for self- and R-S joins, and out-of-core strategies when data exceed node memory, with Hadoop-based speedup/scaleup results. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h3f59bb2d42553a93
Venue
SIGMOD
Year
2010
Pagerank
0.00020001237
Overall Rank
360 | 97.59%
DOI
10.1145/1807167.1807222

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{vernica_sigmod10,
        title = {{Efficient Parallel Set-Similarity Joins Using MapReduce}},
        author = {Vernica, Rares and Carey, Michael J. and Li, Chen},
        series = {{SIGMOD} '10},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1807167.1807222},
        url = {https://dl.acm.org/doi/10.1145/1807167.1807222},
        year = {2010}
}

Incoming Citations (Sorted by Pagerank)

Showing 44 of 44 citing papers.

Rank Citing Paper Year Venue Pagerank
530 Magellan: Toward Building Entity Matching Management Systems 2016 VLDB 0.00016847532
694 JOSIE: Overlap Set Similarity Search for Finding Joinable Tables in Data Lakes 2019 SIGMOD 0.00014721161
718 Finding Related Tables 2012 SIGMOD 0.00014526813
866 Processing Theta-Joins using MapReduce* 2011 SIGMOD 0.00013381756
965 Can We Beat the Prefix Filtering? An Adaptive Framework for Similarity Join and Search 2012 SIGMOD 0.00012810695
1,421 V-SMART-Join: A Scalable MapReduce Framework for All-Pair Similarity Joins of Multisets and Vectors 2012 VLDB 0.00010722146
1,546 Upper and Lower Bounds on the Cost of a Map-Reduce Computation 2013 VLDB 0.0001029751
1,655 Falcon: Scaling Up Hands-Off Crowdsourced Entity Matching to Build Cloud Services 2017 SIGMOD 9.9694129e-05
1,922 ATLAS: A Probabilistic Algorithm for High Dimensional Similarity Search 2011 SIGMOD 9.3726231e-05
1,934 Pass-Join: A Partition-based Method for Similarity Joins 2012 VLDB 9.341845e-05
2,175 Efficient Processing of k Nearest Neighbor Joins using MapReduce 2012 VLDB 8.918268e-05
2,176 Efficient Processing of Data Warehousing Queries in a Split Execution Environment 2011 SIGMOD 8.9150466e-05
2,223 String Similarity Joins: An Experimental Evaluation 2014 VLDB 8.8105347e-05
2,513 An Empirical Evaluation of Set Similarity Join Techniques 2016 VLDB 8.3640659e-05
2,573 Minimal MapReduce Algorithms 2013 SIGMOD 8.2782871e-05
2,577 ClusterJoin: A Similarity Joins Framework using Map-Reduce 2014 VLDB 8.2699584e-05
2,923 Leveraging Set Relations in Exact Set Similarity Join 2017 VLDB 7.8482459e-05
2,932 Efficient Multi-way Theta-Join Processing Using MapReduce 2012 VLDB 7.8368679e-05
2,949 Distributed Data Deduplication 2016 VLDB 7.8193962e-05
3,068 Scalable Big Graph Processing in MapReduce 2014 SIGMOD 7.6841028e-05
3,350 An Efficient Partition Based Method for Exact Set Similarity Joins 2016 VLDB 7.3875743e-05
3,694 Exploiting MapReduce-based Similarity Joins 2012 SIGMOD 7.0902387e-05
3,840 QASCA: A Quality-Aware Task Assignment System for Crowdsourcing Applications 2015 SIGMOD 6.988858e-05
4,109 Smurf: Self-Service String Matching Using Random Forests 2019 VLDB 6.7994518e-05
4,275 Set Similarity Joins on MapReduce: An Experimental Survey 2018 VLDB 6.6887374e-05
4,880 ASTERIX: An Open Source System for "Big Data" Management and Analysis (Demo) 2012 VLDB 6.3689373e-05
4,972 Auto-FuzzyJoin: Auto-Program Fuzzy Similarity Joins Without Labeled Examples 2021 SIGMOD 6.3300201e-05
5,653 Building Wavelet Histograms on Large Data in MapReduce 2012 VLDB 6.048773e-05
5,914 Dima: A Distributed In-Memory Similarity-Based Query Processing System 2017 VLDB 5.9472869e-05
6,122 The Communication Complexity of Distributed Set-Joins with Applications to Matrix Multiplication 2015 PODS 5.8773159e-05
6,151 Similarity Join over Array Data 2016 SIGMOD 5.8678874e-05
6,400 Human-in-the-loop Data Integration 2017 VLDB 5.7962311e-05
7,266 Submodularity of Distributed Join Computation 2018 SIGMOD 5.5689674e-05
7,328 WOO: A Scalable and Multi-tenant Platform for Continuous Knowledge Base Synthesis 2013 VLDB 5.5487234e-05
7,625 SyncSignature: A Simple, Efficient, Parallelizable Framework for Tree Similarity Joins 2023 VLDB 5.4806154e-05
7,716 Scalable Column Concept Determination for Web Tables Using Large Knowledge Bases 2013 VLDB 5.4692136e-05
8,226 Customizable and Scalable Fuzzy Join for Big Data 2019 VLDB 5.3736355e-05
8,697 TxtAlign: Efficient Near-Duplicate Text Alignment Search via Bottom-k Sketches for Plagiarism Detection 2022 SIGMOD 5.2880532e-05
9,136 Balance-Aware Distributed String Similarity-Based Query Processing System 2019 VLDB 5.2213971e-05
9,446 MapReduce Algorithms for Big Data Analysis 2012 VLDB 5.175372e-05
9,821 Streaming Similarity Self-Join 2016 VLDB 5.1233734e-05
11,503 Similarity Joins of Sparse Features 2024 SIGMOD 4.9769913e-05
12,234 ZigZag: Supporting Similarity Queries on Vector Space Models 2018 SIGMOD 4.9769913e-05
12,471 Anti-Combining for MapReduce 2014 SIGMOD 4.9769913e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 11 of 11 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
20 Similarity Search in High Dimensions via Hashing 1999 VLDB 0.0005758001
43 A Comparison of Approaches to Large-Scale Data Analysis 2009 SIGMOD 0.0004552807
75 Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters 2007 SIGMOD 0.0003702496
108 Approximate String Joins in a Database (Almost) for Free 2001 VLDB 0.00033040246
168 Efficient Exact Set-Similarity Joins 2006 VLDB 0.00027151132
201 Efficient set joins on similarity predicates 2004 SIGMOD 0.00025319937
220 An Evaluation of Non-Equijoin Algorithms 1991 VLDB 0.00024333068
249 A Performance Evaluation of Four Parallel Join Algorithms in a Shared-Nothing Multiprocessor Environment 1989 SIGMOD 0.0002316492
651 Building a High-Level Dataflow System on top of Map-Reduce: The Pig Experience 2009 VLDB 0.00015123701
929 Ed-Join: An Efficient Algorithm for Similarity Joins With Edit Distance Constraints 2008 VLDB 0.00013014029
1,213 Bucket Spreading Parallel Hash: A New, Robust, Parallel Hash Join Method for Data Skew in the Super Database Computer (SDC) 1990 VLDB 0.00011508483
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 168 Efficient Exact Set-Similarity Joins 2006 VLDB
2 2,175 Efficient Processing of k Nearest Neighbor Joins using MapReduce 2012 VLDB
3 2,464 Output-optimal Parallel Algorithms for Similarity Joins 2017 PODS
4 201 Efficient set joins on similarity predicates 2004 SIGMOD
5 12,304 Runtime Optimization of Join Location in Parallel Data Management Systems 2017 VLDB
6 75 Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters 2007 SIGMOD
7 799 A Comparison of Join Algorithms for Log Processing in MapReduce 2010 SIGMOD
8 2,577 ClusterJoin: A Similarity Joins Framework using Map-Reduce 2014 VLDB
9 3,694 Exploiting MapReduce-based Similarity Joins 2012 SIGMOD
10 4,275 Set Similarity Joins on MapReduce: An Experimental Survey 2018 VLDB