DBScholar

Back to papers

Efficient set joins on similarity predicates

Summary: General, scalable algorithm for set joins on similarity predicates (intersect size, Jaccard, cosine, edit distance) extending beyond simple containment. Inverted-index probing with staged optimizations, memory-efficient partitioning, and index compression enabling in-memory operation; generalizes to weighted/unweighted partial word overlap. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h47fff8a30c31223b
Venue
SIGMOD
Year
2004
Pagerank
0.00025244506
Overall Rank
202 | 98.65%
DOI
10.1145/1007568.1007652

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{sarawagi_sigmod04,
        title = {{Efficient set joins on similarity predicates}},
        author = {Sarawagi, Sunita and Kirpal, Alok},
        series = {{SIGMOD} '04},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1007568.1007652},
        url = {https://dl.acm.org/doi/10.1145/1007568.1007652},
        year = {2004}
}

Incoming Citations (Sorted by Pagerank)

Showing 50 of 54 citing papers.

Rank Citing Paper Year Venue Pagerank
169 Efficient Exact Set-Similarity Joins 2006 VLDB 0.00027077763
359 Efficient Parallel Set-Similarity Joins Using MapReduce 2010 SIGMOD 0.00019963275
535 On Active Learning of Record Matching Packages 2010 SIGMOD 0.00016768308
886 Framework for Evaluating Clustering Algorithms in Duplicate Detection 2009 VLDB 0.00013215874
934 Ed-Join: An Efficient Algorithm for Similarity Joins With Edit Distance Constraints 2008 VLDB 0.00012973416
966 Can We Beat the Prefix Filtering? An Adaptive Framework for Similarity Join and Search 2012 SIGMOD 0.00012777679
1,068 VGRAM: Improving Performance of Approximate Queries on String Collections Using Variable-Length Grams 2007 VLDB 0.00012170201
1,424 V-SMART-Join: A Scalable MapReduce Framework for All-Pair Similarity Joins of Multisets and Vectors 2012 VLDB 0.00010694144
1,582 Example-driven Design of Efficient Record Matching Queries 2007 VLDB 0.0001015019
1,650 Falcon: Scaling Up Hands-Off Crowdsourced Entity Matching to Build Cloud Services 2017 SIGMOD 9.9690948e-05
1,928 ATLAS: A Probabilistic Algorithm for High Dimensional Similarity Search 2011 SIGMOD 9.3476482e-05
1,941 Pass-Join: A Partition-based Method for Similarity Joins 2012 VLDB 9.3141839e-05
2,084 Bed-Tree: An All-Purpose Index Structure for String Similarity Search Based on Edit Distance 2010 SIGMOD 9.0533042e-05
2,158 Cost-Based Variable-Length-Gram Selection for String Collections to Support Approximate Queries Efficiently 2008 SIGMOD 8.9272802e-05
2,235 String Similarity Joins: An Experimental Evaluation 2014 VLDB 8.7832223e-05
2,362 Hashed Samples: Selectivity Estimators For Set Similarity Selection Queries 2008 VLDB 8.5601252e-05
2,514 An Empirical Evaluation of Set Similarity Join Techniques 2016 VLDB 8.3446573e-05
2,957 Spatio-Textual Similarity Joins 2013 VLDB 7.799694e-05
3,270 Efficient Exact Edit Similarity Query Processing with the Asymmetric Signature Scheme 2011 SIGMOD 7.4613275e-05
3,359 An Efficient Partition Based Method for Exact Set Similarity Joins 2016 VLDB 7.3640394e-05
3,412 Benchmarking Declarative Approximate Selection Predicates 2007 SIGMOD 7.3073062e-05
3,511 An Efficient Filter for Approximate Membership Checking 2008 SIGMOD 7.22602e-05
3,522 Efficient Approximate Entity Extraction with Edit Distance Constraints 2009 SIGMOD 7.2167201e-05
3,604 Overlap Set Similarity Joins with Theoretical Guarantees 2018 SIGMOD 7.1548073e-05
3,785 Parallelizing Query Optimization 2008 VLDB 7.0012696e-05
3,822 Trie-Join: Efficient Trie-based String Similarity Joins with Edit-Distance Constraints 2010 VLDB 6.9814064e-05
4,080 Smurf: Self-Service String Matching Using Random Forests 2019 VLDB 6.8020845e-05
4,167 Local Similarity Search for Unstructured Text 2016 SIGMOD 6.7547438e-05
4,462 Incremental Maintenance of Length Normalized Indexes for Approximate String Matching 2009 SIGMOD 6.5751733e-05
4,551 Power-Law Based Estimation of Set Similarity Join Size 2009 VLDB 6.5314641e-05
4,584 SILKMOTH: An Efficient Method for Finding Related Sets with Maximum Matching Constraints 2017 VLDB 6.5070459e-05
4,756 Scalable Ad-hoc Entity Extraction from Text Collections 2008 VLDB 6.4210101e-05
4,981 Similarity Join Size Estimation using Locality Sensitive Hashing 2011 VLDB 6.3161219e-05
5,135 SEAL: Spatio-Textual Similarity Search 2012 VLDB 6.245475e-05
5,233 String Similarity Measures and Joins with Synonyms 2013 SIGMOD 6.2049921e-05
5,348 On Indexing Error-Tolerant Set Containment 2010 SIGMOD 6.1551499e-05
5,467 Pigeonring: A Principle for Faster Thresholded Similarity Search 2019 VLDB 6.1037173e-05
5,566 Faerie: Efficient Filtering Algorithms for Approximate Dictionary-based Entity Extraction 2011 SIGMOD 6.0651335e-05
5,811 Efficient Approximate Search on String Collections (Tutorial) 2009 VLDB 5.9701598e-05
5,923 Dima: A Distributed In-Memory Similarity-Based Query Processing System 2017 VLDB 5.9283659e-05
6,404 Human-in-the-loop Data Integration 2017 VLDB 5.7797097e-05
7,728 Scalable Column Concept Determination for Web Tables Using Large Knowledge Bases 2013 VLDB 5.4515436e-05
7,917 On the complexity of division and set joins in the relational algebra 2005 PODS 5.4113016e-05
8,019 Set Similarity Join on Probabilistic Data 2010 VLDB 5.3900267e-05
8,241 Customizable and Scalable Fuzzy Join for Big Data 2019 VLDB 5.3560963e-05
9,158 Balance-Aware Distributed String Similarity-Based Query Processing System 2019 VLDB 5.2041319e-05
9,825 On-the-Fly Token Similarity Joins in Relational Databases 2014 SIGMOD 5.1084057e-05
10,225 COMPARE: Accelerating Groupwise Comparison in Relational Databases for Data Analytics 2021 VLDB 5.0460607e-05
10,331 Local Filtering: Improving the Performance of Approximate Queries on String Collections 2015 SIGMOD 5.0228171e-05
10,929 Pail: Efficient kNN Search on Set-Valued Attributes 2026 VLDB 4.9605343e-05
Previous Page 1 / 2 Next

Outgoing Citations (Sorted by Pagerank)

Showing 9 of 9 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
29 Fast Algorithms for Mining Association Rules 1994 VLDB 0.00051028332
108 Approximate String Joins in a Database (Almost) for Free 2001 VLDB 0.00032945275
162 Robust and Efficient Fuzzy Match for Online Data Cleaning 2003 SIGMOD 0.00027626077
220 An Evaluation of Non-Equijoin Algorithms 1991 VLDB 0.00024275691
308 Eliminating Fuzzy Duplicates in Data Warehouses 2002 VLDB 0.0002143466
1,173 Set Containment Joins: The Good, The Bad and The Ugly 2000 VLDB 0.00011659702
1,598 Evaluation of Main Memory Join Algorithms for Joins with Subset Join Predicates 1997 VLDB 0.00010096339
1,628 Efficient Processing of Joins on Set-valued Attributes 2003 SIGMOD 0.00010020209
2,105 Selectivity Estimation For Boolean Queries 2000 PODS 9.0253094e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 11,400 Extensible and Robust Evaluation of Similarity Queries 2025 VLDB
2 359 Efficient Parallel Set-Similarity Joins Using MapReduce 2010 SIGMOD
3 8,434 Fast Approximate Similarity Join in Vector Databases 2025 SIGMOD
4 7,035 Efficient Similarity Join and Search on Multi-Attribute Data 2015 SIGMOD
5 3,604 Overlap Set Similarity Joins with Theoretical Guarantees 2018 SIGMOD
6 3,359 An Efficient Partition Based Method for Exact Set Similarity Joins 2016 VLDB
7 169 Efficient Exact Set-Similarity Joins 2006 VLDB
8 1,628 Efficient Processing of Joins on Set-valued Attributes 2003 SIGMOD
9 2,514 An Empirical Evaluation of Set Similarity Join Techniques 2016 VLDB
10 2,933 Leveraging Set Relations in Exact Set Similarity Join 2017 VLDB