PACk: An Efficient Partition-based Distributed Agglomerative Hierarchical Clustering Algorithm for Deduplication
Summary: Partition-based distributed AHC for deduplication, with distance-based partitioning and distance-aware merging to scale out. Spark implementation delivers 2x to 19x speedup vs. state-of-the-art distributed AHC (median 9x) on real and synthetic datasets. (summarized by gpt-5-nano on Feb 09 2026)
Incoming Non-self Citations Over Time
No non-self incoming citations found for this paper in this database.
Authors
- 1. Yue Wang (Microsoft)
- 2. Vivek Narasayya (Microsoft)
- 3. Yeye He (Microsoft)
- 4. Surajit Chaudhuri (Microsoft)
BibTeX Citation
@article{wang_vldb22,
title = {{PACk: An Efficient Partition-based Distributed Agglomerative Hierarchical Clustering Algorithm for Deduplication}},
author = {Wang, Yue and Narasayya, Vivek and He, Yeye and Chaudhuri, Surajit},
journal = {PVLDB},
series = {{VLDB} '22},
volume = {15},
number = {6},
pages = {1132--1145},
doi = {10.14778/3514061.3514062},
url = {https://doi.org/10.14778/3514061.3514062},
year = {2022}
}Incoming Citations (Sorted by Pagerank)
Showing 0 of 0 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 4 of 4 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 3 | Pregel: A System for Large-Scale Graph Processing | 2010 | SIGMOD | 0.0012250108 |
| 20 | Distributed GraphLab: A Framework for Machine Learning and Data Mining in the Cloud | 2012 | VLDB | 0.00056944564 |
| 735 | Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs | 2011 | VLDB | 0.00014522606 |
| 791 | An Interactive Clustering-based Approach to Integrating Source Query Interfaces on the Deep Web | 2004 | SIGMOD | 0.00013995705 |
Previous
Page 1 / 1
Next