PACk: An Efficient Partition-based Distributed Agglomerative Hierarchical Clustering Algorithm for Deduplication

Summary: Partition-based distributed AHC for deduplication, with distance-based partitioning and distance-aware merging to scale out. Spark implementation delivers 2x to 19x speedup vs. state-of-the-art distributed AHC (median 9x) on real and synthetic datasets. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 12625
Venue: VLDB
Year: 2022
Pagerank: 4.1945683e-05
Overall Rank: 11,368 | 20.92%
DOI: 10.14778/3514061.3514062

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank

Outgoing Citations (Sorted by Pagerank)

Showing 4 of 4 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
4	Pregel: A System for Large-Scale Graph Processing	2010	SIGMOD	0.0019005923
37	Distributed GraphLab: A Framework for Machine Learning and Data Mining in the Cloud	2012	VLDB	0.0007522744
672	An Interactive Clustering-based Approach to Integrating Source Query Interfaces on the Deep Web	2004	SIGMOD	0.00018355746
868	Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs	2011	VLDB	0.00015789681

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
5,417	Theoretically-Efficient and Practical Parallel DBSCAN	2020	SIGMOD	5.5194222e-05
6,104	Automating Distributed Tiered Storage Management in Cluster Computing	2020	VLDB	5.2080102e-05
7,850	Efficient and Effective Attributed Hypergraph Clustering via K-Nearest Neighbor Augmentation	2023	SIGMOD	4.6362484e-05
8,300	sPCA: Scalable Principal Component Analysis for Big Data on Distributed Platforms	2015	SIGMOD	4.5435639e-05
3,295	RP-DBSCAN: A Superfast Parallel DBSCAN Algorithm Based on Random Partitioning	2018	SIGMOD	7.2598552e-05
2,848	Exploiting Matrix Dependency for Efficient Distributed Matrix Computation	2015	SIGMOD	8.0208832e-05
11,477	Fast Parallel Algorithms for Euclidean Minimum Spanning Tree and Hierarchical Spatial Clustering*	2021	SIGMOD	4.1945683e-05
9,681	TeraHAC: Hierarchical Agglomerative Clustering of Trillion-Edge Graphs	2023	SIGMOD	4.3047774e-05
11,466	Fast Density-Peaks Clustering: Multicore-based Parallelization Approach	2021	SIGMOD	4.1945683e-05
11,383	ParChain: A Framework for Parallel Hierarchical Agglomerative Clustering using Nearest-Neighbor Chain	2022	VLDB	4.1945683e-05