Hybrid Edge Partitioner: Partitioning Large Power-Law Graphs under Memory Constraints
Summary: Hybrid Edge Partitioner (HEP) partitions large power-law graphs under memory constraints by splitting edges into two subsets: in-memory NE++ partitioning and streaming partitioning. This tunable memory-overhead approach delivers high partition quality and accelerates Spark/GraphX workloads vs. pure in-memory or streaming methods. (summarized by gpt-5-nano on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Ruben Mayer (Technical University of Munich)
- 2. Hans-Arno Jacobsen (University of Toronto)
BibTeX Citation
@inproceedings{mayer_sigmod21,
title = {{Hybrid Edge Partitioner: Partitioning Large Power-Law Graphs under Memory Constraints}},
author = {Mayer, Ruben and Jacobsen, Hans-Arno},
series = {{SIGMOD} '21},
booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
publisher = {Association for Computing Machinery},
doi = {10.1145/3448016.3457300},
url = {https://dl.acm.org/doi/10.1145/3448016.3457300},
year = {2021}
}Incoming Citations (Sorted by Pagerank)
Showing 6 of 6 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 6,566 | Play like a Vertex: A Stackelberg Game Approach for Streaming Graph Partitioning | 2024 | SIGMOD | 5.8381749e-05 |
| 9,053 | CUTTANA: Scalable Graph Partitioning for Faster Distributed Graph Databases and Analytics | 2025 | VLDB | 5.3251649e-05 |
| 9,879 | Capsule*: An Out-of-Core Training Mechanism for Colossal GNNs | 2025 | SIGMOD | 5.2040783e-05 |
| 10,899 | Can Graph Reordering Speed Up Graph Neural Network Training? An Experimental Study | 2025 | VLDB | 5.093636e-05 |
| 11,097 | A CPU-GPU Hybrid Labelling Algorithm for Massive Shortest Distance Queries on Road Networks | 2025 | VLDB | 5.093636e-05 |
| 11,238 | FSM: A Fine-grained Splitting and Merging Framework for Dual-balanced Graph Partition | 2024 | VLDB | 5.093636e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 9 of 9 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 3 | Pregel: A System for Large-Scale Graph Processing | 2010 | SIGMOD | 0.0012250108 |
| 20 | Distributed GraphLab: A Framework for Machine Learning and Data Mining in the Cloud | 2012 | VLDB | 0.00056944564 |
| 436 | Trinity: A Distributed Graph Engine on a Memory Cloud | 2013 | SIGMOD | 0.00018504439 |
| 1,865 | An Experimental Comparison of Partitioning Strategies in Distributed Graph Processing | 2017 | VLDB | 9.5915721e-05 |
| 3,225 | A Scalable Distributed Graph Partitioner | 2015 | VLDB | 7.6245396e-05 |
| 3,362 | Experimental Analysis of Streaming Algorithms for Graph Partitioning | 2019 | SIGMOD | 7.4833791e-05 |
| 3,752 | Distributed Edge Partitioning for Trillion-edge Graphs | 2019 | VLDB | 7.15217e-05 |
| 4,365 | Application Driven Graph Partitioning | 2020 | SIGMOD | 6.740899e-05 |
| 5,811 | Incrementalization of Graph Partitioning Algorithms | 2020 | VLDB | 6.0782651e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 4,365 | Application Driven Graph Partitioning | 2020 | SIGMOD |
| 2 | 1,803 | Towards Effective Partition Management for Large Graphs | 2012 | SIGMOD |
| 3 | 1,246 | Distributed Evaluation of Subgraph Queries Using Worst-case Optimal Low-Memory Dataflows | 2018 | VLDB |
| 4 | 5,252 | Social Hash Partitioner: A Scalable Distributed Hypergraph Partitioner | 2017 | VLDB |
| 5 | 1,865 | An Experimental Comparison of Partitioning Strategies in Distributed Graph Processing | 2017 | VLDB |
| 6 | 3,362 | Experimental Analysis of Streaming Algorithms for Graph Partitioning | 2019 | SIGMOD |
| 7 | 2,221 | Streaming Graph Partitioning: An Experimental Study | 2018 | VLDB |
| 8 | 6,566 | Play like a Vertex: A Stackelberg Game Approach for Streaming Graph Partitioning | 2024 | SIGMOD |
| 9 | 3,225 | A Scalable Distributed Graph Partitioner | 2015 | VLDB |
| 10 | 3,752 | Distributed Edge Partitioning for Trillion-edge Graphs | 2019 | VLDB |