DBScholar

Back to papers

An Empirical Evaluation of Set Similarity Join Techniques

Summary: Extensive evaluation of seven set-similarity join algorithms reveals verification—not filtering—as the overlooked bottleneck: inspecting a few elements often beats sophisticated filters. Prefix filtering remains central, with AllPairs still competitive despite broadly similar performance. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
h28d76c97274ca5ff
Venue
VLDB
Year
2016
Pagerank
8.3640659e-05
Overall Rank
2,513 | 83.12%
DOI
10.14778/2947618.2947620
PDF
Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{mann_vldb16,
        title = {{An Empirical Evaluation of Set Similarity Join Techniques}},
        author = {Mann, Willi and Augsten, Nikolaus and Bouros, Panagiotis},
        journal = {PVLDB},
        series = {{VLDB} '16},
        volume = {9},
        number = {9},
        pages = {636},
        doi = {10.14778/2947618.2947620},
        url = {https://doi.org/10.14778/2947618.2947620},
        year = {2016}
}

Incoming Citations (Sorted by Pagerank)

Showing 24 of 24 citing papers.

Rank Citing Paper Year Venue Pagerank
694 JOSIE: Overlap Set Similarity Search for Finding Joinable Tables in Data Lakes 2019 SIGMOD 0.00014721161
2,160 Open Data Integration 2018 VLDB 8.9373643e-05
2,568 Locality-Sensitive Hashing for Earthquake Detection: A Case Study of Scaling Data-Driven Science 2018 VLDB 8.2839378e-05
2,923 Leveraging Set Relations in Exact Set Similarity Join 2017 VLDB 7.8482459e-05
3,232 Similarity Query Processing for High-Dimensional Data 2020 VLDB 7.5029541e-05
3,598 Overlap Set Similarity Joins with Theoretical Guarantees 2018 SIGMOD 7.1756405e-05
4,109 Smurf: Self-Service String Matching Using Random Forests 2019 VLDB 6.7994518e-05
4,275 Set Similarity Joins on MapReduce: An Experimental Survey 2018 VLDB 6.6887374e-05
5,449 Pigeonring: A Principle for Faster Thresholded Similarity Search 2019 VLDB 6.123954e-05
7,637 Scalable Distributed Inverted List Indexes in Disaggregated Memory 2024 SIGMOD 5.4772211e-05
8,684 JEDI: These aren't the JSON documents you're looking for... 2022 SIGMOD 5.2885567e-05
8,904 FINEX: A Fast Index for Exact & Flexible Density-Based Clustering 2023 SIGMOD 5.2534908e-05
9,506 Set Similarity Search for Skewed Data 2018 PODS 5.168414e-05
9,746 LES3: Learning-based Exact Set Similarity Search 2021 VLDB 5.1325223e-05
10,727 SeDA: Bridging the Gap between Efficient Syntactic and Precise Semantic Search of Similar Passages in Large Text Corpora 2026 VLDB 4.9769913e-05
10,759 FB*: A Compact Index for Efficient and Exact Density-based Clustering 2026 VLDB 4.9769913e-05
10,868 Pail: Efficient kNN Search on Set-Valued Attributes 2026 VLDB 4.9769913e-05
11,347 Extensible and Robust Evaluation of Similarity Queries 2025 VLDB 4.9769913e-05
11,503 Similarity Joins of Sparse Features 2024 SIGMOD 4.9769913e-05
11,531 Low-Latency Adaptive Distributed Stream Join System Based on a Flexible Join Model 2024 SIGMOD 4.9769913e-05
11,621 Dealing with Acronyms, Abbreviations, and Typos in Real-World Entity Matching 2024 VLDB 4.9769913e-05
11,765 A Two-Level Signature Scheme for Stable Set Similarity Joins 2023 VLDB 4.9769913e-05
11,819 TokenJoin: Efficient Filtering for Set Similarity Join with Maximum Weighted Bipartite Matching 2023 VLDB 4.9769913e-05
12,234 ZigZag: Supporting Similarity Queries on Vector Space Models 2018 SIGMOD 4.9769913e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 9 of 9 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
20 Similarity Search in High Dimensions via Hashing 1999 VLDB 0.0005758001
168 Efficient Exact Set-Similarity Joins 2006 VLDB 0.00027151132
201 Efficient set joins on similarity predicates 2004 SIGMOD 0.00025319937
360 Efficient Parallel Set-Similarity Joins Using MapReduce 2010 SIGMOD 0.00020001237
965 Can We Beat the Prefix Filtering? An Adaptive Framework for Similarity Join and Search 2012 SIGMOD 0.00012810695
990 Bayesian Locality Sensitive Hashing for Fast Similarity Search 2012 VLDB 0.00012643446
1,421 V-SMART-Join: A Scalable MapReduce Framework for All-Pair Similarity Joins of Multisets and Vectors 2012 VLDB 0.00010722146
2,223 String Similarity Joins: An Experimental Evaluation 2014 VLDB 8.8105347e-05
2,945 Spatio-Textual Similarity Joins 2013 VLDB 7.8244366e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 8,003 Set Similarity Join on Probabilistic Data 2010 VLDB
2 7,032 Efficient Similarity Join and Search on Multi-Attribute Data 2015 SIGMOD
3 965 Can We Beat the Prefix Filtering? An Adaptive Framework for Similarity Join and Search 2012 SIGMOD
4 3,598 Overlap Set Similarity Joins with Theoretical Guarantees 2018 SIGMOD
5 11,819 TokenJoin: Efficient Filtering for Set Similarity Join with Maximum Weighted Bipartite Matching 2023 VLDB
6 4,275 Set Similarity Joins on MapReduce: An Experimental Survey 2018 VLDB
7 3,350 An Efficient Partition Based Method for Exact Set Similarity Joins 2016 VLDB
8 168 Efficient Exact Set-Similarity Joins 2006 VLDB
9 201 Efficient set joins on similarity predicates 2004 SIGMOD
10 2,923 Leveraging Set Relations in Exact Set Similarity Join 2017 VLDB