NeutronHeter: Optimizing Distributed Graph Neural Network Training for Heterogeneous Clusters

Summary: NeutronHeter: top-down multi-level mapping on a tree-like resource graph (hierarchical clustering of compute and bandwidth) to solve the multi-constrained multi-way GNN placement problem in heterogeneous clusters. Plus adaptive communication migration via selective vertex replication to bypass low-bandwidth links, reducing asymmetric communication hotspots and yielding 1.06–33.05x speedups over SOTA. (summarized by gpt-5-mini on Feb 11 2026)

Paper ID: he9ee6fcccecf931d
Venue: SIGMOD
Year: 2026
Pagerank: 5.1064323e-05
Overall Rank: 9,835 | 34.08%
DOI: 10.1145/3749175

Incoming Non-self Citations Over Time

Authors

1. Chunyu Cao (Northeastern University)
2. Xin Ai (Northeastern University)
3. Qiange Wang (Northeastern University)
4. Yanfeng Zhang (Northeastern University)
5. Zhenbo Fu (Northeastern University)
6. Hao Yuan (Northeastern University)
7. Mingyi Cao (Northeastern University)
8. Chaoyi Chen (Northeastern University)
9. Yingyou Wen (Neusoft AI Magic Technology Research)
10. Yu Gu (Northeastern University)
11. Ge Yu (Northeastern University)

BibTeX Citation

@inproceedings{cao_sigmod26,
        title = {{NeutronHeter: Optimizing Distributed Graph Neural Network Training for Heterogeneous Clusters}},
        author = {Cao, Chunyu and Ai, Xin and Wang, Qiange and Zhang, Yanfeng and Fu, Zhenbo and Yuan, Hao and Cao, Mingyi and Chen, Chaoyi and Wen, Yingyou and Gu, Yu and Yu, Ge},
        series = {{SIGMOD} '26},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3749175},
        url = {https://dl.acm.org/doi/10.1145/3749175},
        year = {2026}
}

Incoming Citations (Sorted by Pagerank)

Showing 3 of 3 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
10,533	FastGNAS: Accelerating and Scaling Graph Neural Architecture Search on Multi-GPUs via Ring-Based Model Migration	2026	SIGMOD	4.9605343e-05
10,897	FeLoG: Scalable and Efficient Distributed Graph Embedding with Feedback Loop Mechanism	2026	VLDB	4.9605343e-05
11,113	NeutronCloud: Resource-Aware Distributed GNN Training in Fluctuating Cloud Environments	2026	VLDB	4.9605343e-05

Outgoing Citations (Sorted by Pagerank)

Showing 15 of 15 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
203	AliGraph: A Comprehensive Graph Neural Network Platform	2019	VLDB	0.00025234479
1,047	SANCUS: Staleness-Aware Communication-Avoiding Full-Graph Decentralized Training in Large-Scale Graph Neural Networks	2022	VLDB	0.00012313386
1,780	ByteGNN: Efficient Graph Neural Network Training at Large Scale	2022	VLDB	9.6601841e-05
2,196	Heterogeneity-aware Distributed Parameter Servers	2017	SIGMOD	8.8807201e-05
2,273	NeutronStar: Distributed GNN Training with Hybrid Dependency Management	2022	SIGMOD	8.7079974e-05
2,325	Scalable and Efficient Full-Graph GNN Training for Large Graphs	2023	SIGMOD	8.625677e-05
2,513	DUCATI: A Dual-Cache Training System for Graph Neural Networks on Giant Graphs with the GPU	2023	SIGMOD	8.3467757e-05
4,850	DAHA: Accelerating GNN Training with Data and Hardware Aware Execution Planning	2024	VLDB	6.3682022e-05
4,884	NeutronOrch: Rethinking Sample-based GNN Training under CPU-GPU Heterogeneous Environments	2024	VLDB	6.3564568e-05
5,916	Lotan: Bridging the Gap between GNNs and Scalable Graph Analytics Engines	2023	VLDB	5.9320442e-05
6,686	Efficient Training of Graph Neural Networks on Large Graphs	2024	VLDB	5.6931383e-05
6,815	XGNN: Boosting Multi-GPU GNN Training via Global GNN Memory Store	2024	VLDB	5.6595682e-05
6,875	OUTRE: An OUT-of-core De-REdundancy GNN Training Framework for Massive Graphs within A Single Machine	2024	VLDB	5.6433573e-05
6,947	HongTu: Scalable Full-Graph GNN Training on Multiple GPUs	2023	SIGMOD	5.6213095e-05
7,020	RAGraph: A Region-Aware Framework for Geo-Distributed Graph Processing	2024	VLDB	5.6038946e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	9,942	Scalable Graph Convolutional Network Training on Distributed-Memory Systems	2023	VLDB
2	1,780	ByteGNN: Efficient Graph Neural Network Training at Large Scale	2022	VLDB
3	4,524	NeutronStream: A Dynamic GNN Training Framework with Sliding Window for Graph Streams	2024	VLDB
4	2,325	Scalable and Efficient Full-Graph GNN Training for Large Graphs	2023	SIGMOD
5	11,352	Heta: Distributed Training of Heterogeneous Graph Neural Networks	2025	VLDB
6	4,884	NeutronOrch: Rethinking Sample-based GNN Training under CPU-GPU Heterogeneous Environments	2024	VLDB
7	2,273	NeutronStar: Distributed GNN Training with Hybrid Dependency Management	2022	SIGMOD
8	7,544	NeutronTask: Scalable and Efficient Multi-GPU GNN Training with Task Parallelism	2025	VLDB
9	8,174	NeutronTP: Load-Balanced Distributed Full-Graph GNN Training with Tensor Parallelism	2025	VLDB
10	11,113	NeutronCloud: Resource-Aware Distributed GNN Training in Fluctuating Cloud Environments	2026	VLDB