DBScholar

Back to papers

Efficient Parallel Set-Similarity Joins Using MapReduce

Summary: 3-stage end-to-end parallel set-similarity joins on MapReduce. Balanced partitioning with minimal replication, memory-aware processing for self- and R-S joins, and out-of-core strategies when data exceed node memory, with Hadoop-based speedup/scaleup results. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
4331
Venue
SIGMOD
Year
2010
Pagerank
0.00020303289
Overall Rank
356 | 97.56%
DOI
10.1145/1807167.1807222

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{vernica_sigmod10,
        title = {{Efficient Parallel Set-Similarity Joins Using MapReduce}},
        author = {Vernica, Rares and Carey, Michael J. and Li, Chen},
        series = {{SIGMOD} '10},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1807167.1807222},
        url = {https://dl.acm.org/doi/10.1145/1807167.1807222},
        year = {2010}
}

Incoming Citations (Sorted by Pagerank)

Showing 44 of 44 citing papers.

Rank Citing Paper Year Venue Pagerank
529 Magellan: Toward Building Entity Matching Management Systems 2016 VLDB 0.00017096361
739 Finding Related Tables 2012 SIGMOD 0.0001448231
779 JOSIE: Overlap Set Similarity Search for Finding Joinable Tables in Data Lakes 2019 SIGMOD 0.00014092047
843 Processing Theta-Joins using MapReduce* 2011 SIGMOD 0.00013666161
975 Can We Beat the Prefix Filtering? An Adaptive Framework for Similarity Join and Search 2012 SIGMOD 0.00012870645
1,415 V-SMART-Join: A Scalable MapReduce Framework for All-Pair Similarity Joins of Multisets and Vectors 2012 VLDB 0.00010840141
1,514 Upper and Lower Bounds on the Cost of a Map-Reduce Computation 2013 VLDB 0.00010527649
1,643 Falcon: Scaling Up Hands-Off Crowdsourced Entity Matching to Build Cloud Services 2017 SIGMOD 0.00010134956
1,886 Pass-Join: A Partition-based Method for Similarity Joins 2012 VLDB 9.5358137e-05
1,935 ATLAS: A Probabilistic Algorithm for High Dimensional Similarity Search 2011 SIGMOD 9.4560124e-05
2,137 Efficient Processing of k Nearest Neighbor Joins using MapReduce 2012 VLDB 9.110238e-05
2,159 Efficient Processing of Data Warehousing Queries in a Split Execution Environment 2011 SIGMOD 9.061086e-05
2,186 String Similarity Joins: An Experimental Evaluation 2014 VLDB 9.0001436e-05
2,501 An Empirical Evaluation of Set Similarity Join Techniques 2016 VLDB 8.4975661e-05
2,539 Minimal MapReduce Algorithms 2013 SIGMOD 8.4526595e-05
2,567 ClusterJoin: A Similarity Joins Framework using Map-Reduce 2014 VLDB 8.4098241e-05
2,887 Efficient Multi-way Theta-Join Processing Using MapReduce 2012 VLDB 7.9952432e-05
2,893 Distributed Data Deduplication 2016 VLDB 7.983961e-05
3,008 Scalable Big Graph Processing in MapReduce 2014 SIGMOD 7.8578871e-05
3,040 Leveraging Set Relations in Exact Set Similarity Join 2017 VLDB 7.8262287e-05
3,474 An Efficient Partition Based Method for Exact Set Similarity Joins 2016 VLDB 7.3859271e-05
3,671 Exploiting MapReduce-based Similarity Joins 2012 SIGMOD 7.2117915e-05
3,904 QASCA: A Quality-Aware Task Assignment System for Crowdsourcing Applications 2015 SIGMOD 7.0304212e-05
4,023 Smurf: Self-Service String Matching Using Random Forests 2019 VLDB 6.949387e-05
4,260 Set Similarity Joins on MapReduce: An Experimental Survey 2018 VLDB 6.7984322e-05
4,778 ASTERIX: An Open Source System for "Big Data" Management and Analysis (Demo) 2012 VLDB 6.5133529e-05
5,134 Auto-FuzzyJoin: Auto-Program Fuzzy Similarity Joins Without Labeled Examples 2021 SIGMOD 6.3532024e-05
5,522 Building Wavelet Histograms on Large Data in MapReduce 2012 VLDB 6.1871697e-05
5,996 The Communication Complexity of Distributed Set-Joins with Applications to Matrix Multiplication 2015 PODS 6.0150613e-05
6,157 Similarity Join over Array Data 2016 SIGMOD 5.9554363e-05
6,290 Dima: A Distributed In-Memory Similarity-Based Query Processing System 2017 VLDB 5.9253163e-05
7,111 Submodularity of Distributed Join Computation 2018 SIGMOD 5.69924e-05
7,204 WOO: A Scalable and Multi-tenant Platform for Continuous Knowledge Base Synthesis 2013 VLDB 5.6739087e-05
7,476 SyncSignature: A Simple, Efficient, Parallelizable Framework for Tree Similarity Joins 2023 VLDB 5.6090634e-05
7,493 Human-in-the-loop Data Integration 2017 VLDB 5.6046905e-05
7,575 Scalable Column Concept Determination for Web Tables Using Large Knowledge Bases 2013 VLDB 5.5937684e-05
8,088 Customizable and Scalable Fuzzy Join for Big Data 2019 VLDB 5.4900832e-05
8,522 TxtAlign: Efficient Near-Duplicate Text Alignment Search via Bottom-k Sketches for Plagiarism Detection 2022 SIGMOD 5.4119882e-05
9,263 MapReduce Algorithms for Big Data Analysis 2012 VLDB 5.2966408e-05
9,638 Streaming Similarity Self-Join 2016 VLDB 5.2434488e-05
9,979 Balance-Aware Distributed String Similarity-Based Query Processing System 2019 VLDB 5.1845938e-05
11,149 Similarity Joins of Sparse Features 2024 SIGMOD 5.093636e-05
11,929 ZigZag: Supporting Similarity Queries on Vector Space Models 2018 SIGMOD 5.093636e-05
12,174 Anti-Combining for MapReduce 2014 SIGMOD 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 11 of 11 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
21 Similarity Search in High Dimensions via Hashing 1999 VLDB 0.00056760516
44 A Comparison of Approaches to Large-Scale Data Analysis 2009 SIGMOD 0.00046055057
72 Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters 2007 SIGMOD 0.00037695852
107 Approximate String Joins in a Database (Almost) for Free 2001 VLDB 0.00033511706
169 Efficient Exact Set-Similarity Joins 2006 VLDB 0.0002743469
200 Efficient set joins on similarity predicates 2004 SIGMOD 0.00025597287
210 An Evaluation of Non-Equijoin Algorithms 1991 VLDB 0.00024797689
242 A Performance Evaluation of Four Parallel Join Algorithms in a Shared-Nothing Multiprocessor Environment 1989 SIGMOD 0.00023604323
642 Building a High-Level Dataflow System on top of Map-Reduce: The Pig Experience 2009 VLDB 0.00015395331
911 Ed-Join: An Efficient Algorithm for Similarity Joins With Edit Distance Constraints 2008 VLDB 0.00013283031
1,188 Bucket Spreading Parallel Hash: A New, Robust, Parallel Hash Join Method for Data Skew in the Super Database Computer (SDC) 1990 VLDB 0.00011756444
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 169 Efficient Exact Set-Similarity Joins 2006 VLDB
2 2,137 Efficient Processing of k Nearest Neighbor Joins using MapReduce 2012 VLDB
3 2,462 Output-optimal Parallel Algorithms for Similarity Joins 2017 PODS
4 200 Efficient set joins on similarity predicates 2004 SIGMOD
5 12,001 Runtime Optimization of Join Location in Parallel Data Management Systems 2017 VLDB
6 72 Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters 2007 SIGMOD
7 769 A Comparison of Join Algorithms for Log Processing in MapReduce 2010 SIGMOD
8 2,567 ClusterJoin: A Similarity Joins Framework using Map-Reduce 2014 VLDB
9 3,671 Exploiting MapReduce-based Similarity Joins 2012 SIGMOD
10 4,260 Set Similarity Joins on MapReduce: An Experimental Survey 2018 VLDB