DBScholar

Back to papers

An Empirical Evaluation of Set Similarity Join Techniques

Summary: Extensive evaluation of seven set-similarity join algorithms reveals verification—not filtering—as the overlooked bottleneck: inspecting a few elements often beats sophisticated filters. Prefix filtering remains central, with AllPairs still competitive despite broadly similar performance. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
h28d76c97274ca5ff
Venue
VLDB
Year
2016
Pagerank
8.3679178e-05
Overall Rank
2,513 | 83.11%
DOI
10.14778/2947618.2947620

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{mann_vldb16,
        title = {{An Empirical Evaluation of Set Similarity Join Techniques}},
        author = {Mann, Willi and Augsten, Nikolaus and Bouros, Panagiotis},
        journal = {PVLDB},
        series = {{VLDB} '16},
        volume = {9},
        number = {9},
        pages = {636},
        doi = {10.14778/2947618.2947620},
        url = {https://doi.org/10.14778/2947618.2947620},
        year = {2016}
}

Incoming Citations (Sorted by Pagerank)

Showing 24 of 24 citing papers.

Rank Citing Paper Year Venue Pagerank
694 JOSIE: Overlap Set Similarity Search for Finding Joinable Tables in Data Lakes 2019 SIGMOD 0.00014727089
2,158 Open Data Integration 2018 VLDB 8.941016e-05
2,568 Locality-Sensitive Hashing for Earthquake Detection: A Case Study of Scaling Data-Driven Science 2018 VLDB 8.2870435e-05
2,921 Leveraging Set Relations in Exact Set Similarity Join 2017 VLDB 7.8519256e-05
3,230 Similarity Query Processing for High-Dimensional Data 2020 VLDB 7.5056037e-05
3,596 Overlap Set Similarity Joins with Theoretical Guarantees 2018 SIGMOD 7.1790375e-05
4,107 Smurf: Self-Service String Matching Using Random Forests 2019 VLDB 6.8026037e-05
4,274 Set Similarity Joins on MapReduce: An Experimental Survey 2018 VLDB 6.6918599e-05
5,444 Pigeonring: A Principle for Faster Thresholded Similarity Search 2019 VLDB 6.1268526e-05
7,631 Scalable Distributed Inverted List Indexes in Disaggregated Memory 2024 SIGMOD 5.4798152e-05
8,676 JEDI: These aren't the JSON documents you're looking for... 2022 SIGMOD 5.2910615e-05
8,896 FINEX: A Fast Index for Exact & Flexible Density-Based Clustering 2023 SIGMOD 5.2559789e-05
9,495 Set Similarity Search for Skewed Data 2018 PODS 5.1708619e-05
9,741 LES3: Learning-based Exact Set Similarity Search 2021 VLDB 5.1349531e-05
10,717 SeDA: Bridging the Gap between Efficient Syntactic and Precise Semantic Search of Similar Passages in Large Text Corpora 2026 VLDB 4.9793485e-05
10,749 FB*: A Compact Index for Efficient and Exact Density-based Clustering 2026 VLDB 4.9793485e-05
10,859 Pail: Efficient kNN Search on Set-Valued Attributes 2026 VLDB 4.9793485e-05
11,339 Extensible and Robust Evaluation of Similarity Queries 2025 VLDB 4.9793485e-05
11,497 Similarity Joins of Sparse Features 2024 SIGMOD 4.9793485e-05
11,525 Low-Latency Adaptive Distributed Stream Join System Based on a Flexible Join Model 2024 SIGMOD 4.9793485e-05
11,615 Dealing with Acronyms, Abbreviations, and Typos in Real-World Entity Matching 2024 VLDB 4.9793485e-05
11,759 A Two-Level Signature Scheme for Stable Set Similarity Joins 2023 VLDB 4.9793485e-05
11,813 TokenJoin: Efficient Filtering for Set Similarity Join with Maximum Weighted Bipartite Matching 2023 VLDB 4.9793485e-05
12,228 ZigZag: Supporting Similarity Queries on Vector Space Models 2018 SIGMOD 4.9793485e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 9 of 9 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
20 Similarity Search in High Dimensions via Hashing 1999 VLDB 0.00057568153
168 Efficient Exact Set-Similarity Joins 2006 VLDB 0.00027163517
201 Efficient set joins on similarity predicates 2004 SIGMOD 0.00025331535
360 Efficient Parallel Set-Similarity Joins Using MapReduce 2010 SIGMOD 0.00020009936
963 Can We Beat the Prefix Filtering? An Adaptive Framework for Similarity Join and Search 2012 SIGMOD 0.00012816649
992 Bayesian Locality Sensitive Hashing for Fast Similarity Search 2012 VLDB 0.00012646771
1,421 V-SMART-Join: A Scalable MapReduce Framework for All-Pair Similarity Joins of Multisets and Vectors 2012 VLDB 0.00010726757
2,220 String Similarity Joins: An Experimental Evaluation 2014 VLDB 8.8146984e-05
2,944 Spatio-Textual Similarity Joins 2013 VLDB 7.828107e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 7,998 Set Similarity Join on Probabilistic Data 2010 VLDB
2 7,030 Efficient Similarity Join and Search on Multi-Attribute Data 2015 SIGMOD
3 963 Can We Beat the Prefix Filtering? An Adaptive Framework for Similarity Join and Search 2012 SIGMOD
4 3,596 Overlap Set Similarity Joins with Theoretical Guarantees 2018 SIGMOD
5 11,813 TokenJoin: Efficient Filtering for Set Similarity Join with Maximum Weighted Bipartite Matching 2023 VLDB
6 4,274 Set Similarity Joins on MapReduce: An Experimental Survey 2018 VLDB
7 3,350 An Efficient Partition Based Method for Exact Set Similarity Joins 2016 VLDB
8 168 Efficient Exact Set-Similarity Joins 2006 VLDB
9 201 Efficient set joins on similarity predicates 2004 SIGMOD
10 2,921 Leveraging Set Relations in Exact Set Similarity Join 2017 VLDB