Database Paper Browser

Back to papers

Efficient Parallel Set-Similarity Joins Using MapReduce

Summary: 3-stage end-to-end parallel set-similarity joins on MapReduce. Balanced partitioning with minimal replication, memory-aware processing for self- and R-S joins, and out-of-core strategies when data exceed node memory, with Hadoop-based speedup/scaleup results. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
4270
Venue
SIGMOD
Year
2010
Pagerank
0.00023095823
Overall Rank
442 | 96.93%
DOI
-

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 44 of 44 citing papers.

Rank Citing Paper Year Venue Pagerank
705 Magellan: Toward Building Entity Matching Management Systems 2016 VLDB 0.00017779048
814 Finding Related Tables 2012 SIGMOD 0.00016298739
1,073 Processing Theta-Joins using MapReduce* 2011 SIGMOD 0.00014255717
1,185 JOSIE: Overlap Set Similarity Search for Finding Joinable Tables in Data Lakes 2019 SIGMOD 0.00013432692
1,312 Upper and Lower Bounds on the Cost of a Map-Reduce Computation 2013 VLDB 0.00012650678
1,396 Can We Beat the Prefix Filtering? An Adaptive Framework for Similarity Join and Search 2012 SIGMOD 0.00012215253
1,775 V-SMART-Join: A Scalable MapReduce Framework for All-Pair Similarity Joins of Multisets and Vectors 2012 VLDB 0.00010584816
1,927 Efficient Processing of k Nearest Neighbor Joins using MapReduce 2012 VLDB 0.00010062395
2,012 ATLAS: A Probabilistic Algorithm for High Dimensional Similarity Search 2011 SIGMOD 9.8007613e-05
2,176 Falcon: Scaling Up Hands-Off Crowdsourced Entity Matching to Build Cloud Services 2017 SIGMOD 9.3729351e-05
2,340 Efficient Processing of Data Warehousing Queries in a Split Execution Environment 2011 SIGMOD 9.001663e-05
2,588 Pass-Join: A Partition-based Method for Similarity Joins 2012 VLDB 8.4872437e-05
2,714 Minimal MapReduce Algorithms 2013 SIGMOD 8.2426646e-05
2,729 String Similarity Joins: An Experimental Evaluation 2014 VLDB 8.2175463e-05
3,068 Efficient Multi-way Theta-Join Processing Using MapReduce 2012 VLDB 7.6241861e-05
3,139 ClusterJoin: A Similarity Joins Framework using Map-Reduce 2014 VLDB 7.4915127e-05
3,188 Scalable Big Graph Processing in MapReduce 2014 SIGMOD 7.4142307e-05
3,209 An Empirical Evaluation of Set Similarity Join Techniques 2016 VLDB 7.3793885e-05
3,268 QASCA: A Quality-Aware Task Assignment System for Crowdsourcing Applications 2015 SIGMOD 7.3027561e-05
3,461 Leveraging Set Relations in Exact Set Similarity Join 2017 VLDB 7.0696567e-05
3,526 Distributed Data Deduplication 2016 VLDB 7.0056559e-05
4,041 An Efficient Partition Based Method for Exact Set Similarity Joins 2016 VLDB 6.5048916e-05
4,130 Exploiting MapReduce-based Similarity Joins 2012 SIGMOD 6.4205218e-05
4,397 Smurf: Self-Service String Matching Using Random Forests 2019 VLDB 6.2142485e-05
4,496 ASTERIX: An Open Source System for "Big Data" Management and Analysis (Demo) 2012 VLDB 6.1357056e-05
4,752 Set Similarity Joins on MapReduce: An Experimental Survey 2018 VLDB 5.9396804e-05
5,388 Auto-FuzzyJoin: Auto-Program Fuzzy Similarity Joins Without Labeled Examples 2021 SIGMOD 5.5342724e-05
5,905 The Communication Complexity of Distributed Set-Joins with Applications to Matrix Multiplication 2015 PODS 5.2746158e-05
5,908 Building Wavelet Histograms on Large Data in MapReduce 2012 VLDB 5.2731311e-05
6,103 WOO: A Scalable and Multi-tenant Platform for Continuous Knowledge Base Synthesis 2013 VLDB 5.2054474e-05
6,502 Similarity Join over Array Data 2016 SIGMOD 5.0288901e-05
6,559 Dima: A Distributed In-Memory Similarity-Based Query Processing System 2017 VLDB 5.00593e-05
7,154 Submodularity of Distributed Join Computation 2018 SIGMOD 4.8107765e-05
7,215 SyncSignature: A Simple, Efficient, Parallelizable Framework for Tree Similarity Joins 2023 VLDB 4.7939964e-05
7,590 Scalable Column Concept Determination for Web Tables Using Large Knowledge Bases 2013 VLDB 4.6987033e-05
7,667 Human-in-the-loop Data Integration 2017 VLDB 4.6791871e-05
8,116 Customizable and Scalable Fuzzy Join for Big Data 2019 VLDB 4.5788731e-05
8,284 TxtAlign: Efficient Near-Duplicate Text Alignment Search via Bottom-k Sketches for Plagiarism Detection 2022 SIGMOD 4.5392079e-05
9,113 MapReduce Algorithms for Big Data Analysis 2012 VLDB 4.3889284e-05
9,503 Streaming Similarity Self-Join 2016 VLDB 4.3300131e-05
9,831 Balance-Aware Distributed String Similarity-Based Query Processing System 2019 VLDB 4.2710095e-05
10,933 Similarity Joins of Sparse Features 2024 SIGMOD 4.1905499e-05
11,730 ZigZag: Supporting Similarity Queries on Vector Space Models 2018 SIGMOD 4.1905499e-05
11,984 Anti-Combining for MapReduce 2014 SIGMOD 4.1905499e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 11 of 11 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
15 Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters 2007 SIGMOD 0.0010668335
34 Similarity Search in High Dimensions via Hashing 1999 VLDB 0.00076824554
42 A Comparison of Approaches to Large-Scale Data Analysis 2009 SIGMOD 0.00073570328
125 Approximate String Joins in a Database (Almost) for Free 2001 VLDB 0.00044946098
151 An Evaluation of Non-Equijoin Algorithms 1991 VLDB 0.00041010211
230 A Performance Evaluation of Four Parallel Join Algorithms in a Shared-Nothing Multiprocessor Environment 1989 SIGMOD 0.00032145125
248 Efficient set joins on similarity predicates 2004 SIGMOD 0.00030888982
264 Efficient Exact Set-Similarity Joins 2006 VLDB 0.00029950264
776 Building a High-Level Dataflow System on top of Map-Reduce: The Pig Experience 2009 VLDB 0.00016765694
1,219 Bucket Spreading Parallel Hash: A New, Robust, Parallel Hash Join Method for Data Skew in the Super Database Computer (SDC) 1990 VLDB 0.00013215689
1,232 Ed-Join: An Efficient Algorithm for Similarity Joins With Edit Distance Constraints 2008 VLDB 0.00013133604
Previous Page 1 / 1 Next

Semantically Similar Papers

Overall Rank Paper Year Venue Pagerank
264 Efficient Exact Set-Similarity Joins 2006 VLDB 0.00029950264
1,927 Efficient Processing of k Nearest Neighbor Joins using MapReduce 2012 VLDB 0.00010062395
3,831 Output-optimal Parallel Algorithms for Similarity Joins 2017 PODS 6.7146681e-05
248 Efficient set joins on similarity predicates 2004 SIGMOD 0.00030888982
11,805 Runtime Optimization of Join Location in Parallel Data Management Systems 2017 VLDB 4.1905499e-05
15 Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters 2007 SIGMOD 0.0010668335
962 A Comparison of Join Algorithms for Log Processing in MapReduce 2010 SIGMOD 0.00015003834
3,139 ClusterJoin: A Similarity Joins Framework using Map-Reduce 2014 VLDB 7.4915127e-05
4,130 Exploiting MapReduce-based Similarity Joins 2012 SIGMOD 6.4205218e-05
4,752 Set Similarity Joins on MapReduce: An Experimental Survey 2018 VLDB 5.9396804e-05