DBScholar

Back to papers

Efficient Parallel Set-Similarity Joins Using MapReduce

Summary: 3-stage end-to-end parallel set-similarity joins on MapReduce. Balanced partitioning with minimal replication, memory-aware processing for self- and R-S joins, and out-of-core strategies when data exceed node memory, with Hadoop-based speedup/scaleup results. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h3f59bb2d42553a93
Venue
SIGMOD
Year
2010
Pagerank
0.00020009936
Overall Rank
360 | 97.59%
DOI
10.1145/1807167.1807222

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{vernica_sigmod10,
        title = {{Efficient Parallel Set-Similarity Joins Using MapReduce}},
        author = {Vernica, Rares and Carey, Michael J. and Li, Chen},
        series = {{SIGMOD} '10},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1807167.1807222},
        url = {https://dl.acm.org/doi/10.1145/1807167.1807222},
        year = {2010}
}

Incoming Citations (Sorted by Pagerank)

Showing 44 of 44 citing papers.

Rank Citing Paper Year Venue Pagerank
530 Magellan: Toward Building Entity Matching Management Systems 2016 VLDB 0.00016855162
694 JOSIE: Overlap Set Similarity Search for Finding Joinable Tables in Data Lakes 2019 SIGMOD 0.00014727089
717 Finding Related Tables 2012 SIGMOD 0.00014532116
865 Processing Theta-Joins using MapReduce* 2011 SIGMOD 0.0001338765
963 Can We Beat the Prefix Filtering? An Adaptive Framework for Similarity Join and Search 2012 SIGMOD 0.00012816649
1,421 V-SMART-Join: A Scalable MapReduce Framework for All-Pair Similarity Joins of Multisets and Vectors 2012 VLDB 0.00010726757
1,545 Upper and Lower Bounds on the Cost of a Map-Reduce Computation 2013 VLDB 0.00010302384
1,654 Falcon: Scaling Up Hands-Off Crowdsourced Entity Matching to Build Cloud Services 2017 SIGMOD 9.9739611e-05
1,923 ATLAS: A Probabilistic Algorithm for High Dimensional Similarity Search 2011 SIGMOD 9.3750526e-05
1,933 Pass-Join: A Partition-based Method for Similarity Joins 2012 VLDB 9.3459285e-05
2,173 Efficient Processing of Data Warehousing Queries in a Split Execution Environment 2011 SIGMOD 8.91924e-05
2,176 Efficient Processing of k Nearest Neighbor Joins using MapReduce 2012 VLDB 8.9159001e-05
2,220 String Similarity Joins: An Experimental Evaluation 2014 VLDB 8.8146984e-05
2,513 An Empirical Evaluation of Set Similarity Join Techniques 2016 VLDB 8.3679178e-05
2,573 Minimal MapReduce Algorithms 2013 SIGMOD 8.2821647e-05
2,577 ClusterJoin: A Similarity Joins Framework using Map-Reduce 2014 VLDB 8.2738285e-05
2,921 Leveraging Set Relations in Exact Set Similarity Join 2017 VLDB 7.8519256e-05
2,931 Efficient Multi-way Theta-Join Processing Using MapReduce 2012 VLDB 7.8405483e-05
2,948 Distributed Data Deduplication 2016 VLDB 7.8230494e-05
3,066 Scalable Big Graph Processing in MapReduce 2014 SIGMOD 7.6877117e-05
3,350 An Efficient Partition Based Method for Exact Set Similarity Joins 2016 VLDB 7.3910669e-05
3,691 Exploiting MapReduce-based Similarity Joins 2012 SIGMOD 7.0935524e-05
3,839 QASCA: A Quality-Aware Task Assignment System for Crowdsourcing Applications 2015 SIGMOD 6.9921604e-05
4,107 Smurf: Self-Service String Matching Using Random Forests 2019 VLDB 6.8026037e-05
4,274 Set Similarity Joins on MapReduce: An Experimental Survey 2018 VLDB 6.6918599e-05
4,878 ASTERIX: An Open Source System for "Big Data" Management and Analysis (Demo) 2012 VLDB 6.3718961e-05
4,970 Auto-FuzzyJoin: Auto-Program Fuzzy Similarity Joins Without Labeled Examples 2021 SIGMOD 6.3329595e-05
5,652 Building Wavelet Histograms on Large Data in MapReduce 2012 VLDB 6.0515502e-05
5,912 Dima: A Distributed In-Memory Similarity-Based Query Processing System 2017 VLDB 5.9501002e-05
6,121 The Communication Complexity of Distributed Set-Joins with Applications to Matrix Multiplication 2015 PODS 5.8800995e-05
6,149 Similarity Join over Array Data 2016 SIGMOD 5.8706665e-05
6,397 Human-in-the-loop Data Integration 2017 VLDB 5.7989499e-05
7,259 Submodularity of Distributed Join Computation 2018 SIGMOD 5.5716049e-05
7,326 WOO: A Scalable and Multi-tenant Platform for Continuous Knowledge Base Synthesis 2013 VLDB 5.5513502e-05
7,619 SyncSignature: A Simple, Efficient, Parallelizable Framework for Tree Similarity Joins 2023 VLDB 5.4832111e-05
7,709 Scalable Column Concept Determination for Web Tables Using Large Knowledge Bases 2013 VLDB 5.4717883e-05
8,219 Customizable and Scalable Fuzzy Join for Big Data 2019 VLDB 5.3761699e-05
8,689 TxtAlign: Efficient Near-Duplicate Text Alignment Search via Bottom-k Sketches for Plagiarism Detection 2022 SIGMOD 5.2905577e-05
9,126 Balance-Aware Distributed String Similarity-Based Query Processing System 2019 VLDB 5.22387e-05
9,437 MapReduce Algorithms for Big Data Analysis 2012 VLDB 5.1778231e-05
9,814 Streaming Similarity Self-Join 2016 VLDB 5.1257999e-05
11,497 Similarity Joins of Sparse Features 2024 SIGMOD 4.9793485e-05
12,228 ZigZag: Supporting Similarity Queries on Vector Space Models 2018 SIGMOD 4.9793485e-05
12,465 Anti-Combining for MapReduce 2014 SIGMOD 4.9793485e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 11 of 11 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
20 Similarity Search in High Dimensions via Hashing 1999 VLDB 0.00057568153
43 A Comparison of Approaches to Large-Scale Data Analysis 2009 SIGMOD 0.00045546775
75 Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters 2007 SIGMOD 0.0003704106
108 Approximate String Joins in a Database (Almost) for Free 2001 VLDB 0.0003305531
168 Efficient Exact Set-Similarity Joins 2006 VLDB 0.00027163517
201 Efficient set joins on similarity predicates 2004 SIGMOD 0.00025331535
220 An Evaluation of Non-Equijoin Algorithms 1991 VLDB 0.00024344086
249 A Performance Evaluation of Four Parallel Join Algorithms in a Shared-Nothing Multiprocessor Environment 1989 SIGMOD 0.00023175253
651 Building a High-Level Dataflow System on top of Map-Reduce: The Pig Experience 2009 VLDB 0.00015130782
929 Ed-Join: An Efficient Algorithm for Similarity Joins With Edit Distance Constraints 2008 VLDB 0.00013020115
1,212 Bucket Spreading Parallel Hash: A New, Robust, Parallel Hash Join Method for Data Skew in the Super Database Computer (SDC) 1990 VLDB 0.00011513842
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 168 Efficient Exact Set-Similarity Joins 2006 VLDB
2 2,176 Efficient Processing of k Nearest Neighbor Joins using MapReduce 2012 VLDB
3 2,464 Output-optimal Parallel Algorithms for Similarity Joins 2017 PODS
4 201 Efficient set joins on similarity predicates 2004 SIGMOD
5 12,298 Runtime Optimization of Join Location in Parallel Data Management Systems 2017 VLDB
6 75 Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters 2007 SIGMOD
7 799 A Comparison of Join Algorithms for Log Processing in MapReduce 2010 SIGMOD
8 2,577 ClusterJoin: A Similarity Joins Framework using Map-Reduce 2014 VLDB
9 3,691 Exploiting MapReduce-based Similarity Joins 2012 SIGMOD
10 4,274 Set Similarity Joins on MapReduce: An Experimental Survey 2018 VLDB