NeutronHeter: Optimizing Distributed Graph Neural Network Training for Heterogeneous Clusters

Summary: NeutronHeter: top-down multi-level mapping on a tree-like resource graph (hierarchical clustering of compute and bandwidth) to solve the multi-constrained multi-way GNN placement problem in heterogeneous clusters. Plus adaptive communication migration via selective vertex replication to bypass low-bandwidth links, reducing asymmetric communication hotspots and yielding 1.06–33.05x speedups over SOTA. (summarized by gpt-5-mini on Feb 11 2026)

Paper ID: he9ee6fcccecf931d
Venue: SIGMOD
Year: 2026
Pagerank: 5.1257999e-05
Overall Rank: 9,795 | 34.15%
DOI: 10.1145/3749175

Incoming Non-self Citations Over Time

Authors

1. Chunyu Cao (Northeastern University)
2. Xin Ai (Northeastern University)
3. Qiange Wang (Northeastern University)
4. Yanfeng Zhang (Northeastern University)
5. Zhenbo Fu (Northeastern University)
6. Hao Yuan (Northeastern University)
7. Mingyi Cao (Northeastern University)
8. Chaoyi Chen (Northeastern University)
9. Yingyou Wen (Neusoft AI Magic Technology Research)
10. Yu Gu (Northeastern University)
11. Ge Yu (Northeastern University)

BibTeX Citation

@inproceedings{cao_sigmod26,
        title = {{NeutronHeter: Optimizing Distributed Graph Neural Network Training for Heterogeneous Clusters}},
        author = {Cao, Chunyu and Ai, Xin and Wang, Qiange and Zhang, Yanfeng and Fu, Zhenbo and Yuan, Hao and Cao, Mingyi and Chen, Chaoyi and Wen, Yingyou and Gu, Yu and Yu, Ge},
        series = {{SIGMOD} '26},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3749175},
        url = {https://dl.acm.org/doi/10.1145/3749175},
        year = {2026}
}

Incoming Citations (Sorted by Pagerank)

Showing 3 of 3 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
10,456	FastGNAS: Accelerating and Scaling Graph Neural Architecture Search on Multi-GPUs via Ring-Based Model Migration	2026	SIGMOD	4.9793485e-05
10,826	FeLoG: Scalable and Efficient Distributed Graph Embedding with Feedback Loop Mechanism	2026	VLDB	4.9793485e-05
11,043	NeutronCloud: Resource-Aware Distributed GNN Training in Fluctuating Cloud Environments	2026	VLDB	4.9793485e-05

Outgoing Citations (Sorted by Pagerank)

Showing 15 of 15 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
211	AliGraph: A Comprehensive Graph Neural Network Platform	2019	VLDB	0.00024816965
1,134	SANCUS: Staleness-Aware Communication-Avoiding Full-Graph Decentralized Training in Large-Scale Graph Neural Networks	2022	VLDB	0.00011893521
1,772	ByteGNN: Efficient Graph Neural Network Training at Large Scale	2022	VLDB	9.6792287e-05
2,184	Heterogeneity-aware Distributed Parameter Servers	2017	SIGMOD	8.8958335e-05
2,279	NeutronStar: Distributed GNN Training with Hybrid Dependency Management	2022	SIGMOD	8.7062637e-05
2,506	DUCATI: A Dual-Cache Training System for Graph Neural Networks on Giant Graphs with the GPU	2023	SIGMOD	8.3774747e-05
2,596	Scalable and Efficient Full-Graph GNN Training for Large Graphs	2023	SIGMOD	8.2419456e-05
4,825	DAHA: Accelerating GNN Training with Data and Hardware Aware Execution Planning	2024	VLDB	6.3923554e-05
4,853	NeutronOrch: Rethinking Sample-based GNN Training under CPU-GPU Heterogeneous Environments	2024	VLDB	6.3805655e-05
5,899	Lotan: Bridging the Gap between GNNs and Scalable Graph Analytics Engines	2023	VLDB	5.9545431e-05
6,669	Efficient Training of Graph Neural Networks on Large Graphs	2024	VLDB	5.7147311e-05
6,793	XGNN: Boosting Multi-GPU GNN Training via Global GNN Memory Store	2024	VLDB	5.6810336e-05
6,852	OUTRE: An OUT-of-core De-REdundancy GNN Training Framework for Massive Graphs within A Single Machine	2024	VLDB	5.6647613e-05
6,924	HongTu: Scalable Full-Graph GNN Training on Multiple GPUs	2023	SIGMOD	5.6426299e-05
7,000	RAGraph: A Region-Aware Framework for Geo-Distributed Graph Processing	2024	VLDB	5.6251489e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	9,900	Scalable Graph Convolutional Network Training on Distributed-Memory Systems	2023	VLDB
2	1,772	ByteGNN: Efficient Graph Neural Network Training at Large Scale	2022	VLDB
3	4,502	NeutronStream: A Dynamic GNN Training Framework with Sliding Window for Graph Streams	2024	VLDB
4	2,596	Scalable and Efficient Full-Graph GNN Training for Large Graphs	2023	SIGMOD
5	11,289	Heta: Distributed Training of Heterogeneous Graph Neural Networks	2025	VLDB
6	4,853	NeutronOrch: Rethinking Sample-based GNN Training under CPU-GPU Heterogeneous Environments	2024	VLDB
7	2,279	NeutronStar: Distributed GNN Training with Hybrid Dependency Management	2022	SIGMOD
8	7,522	NeutronTask: Scalable and Efficient Multi-GPU GNN Training with Task Parallelism	2025	VLDB
9	8,152	NeutronTP: Load-Balanced Distributed Full-Graph GNN Training with Tensor Parallelism	2025	VLDB
10	11,043	NeutronCloud: Resource-Aware Distributed GNN Training in Fluctuating Cloud Environments	2026	VLDB