NeutronTP: Load-Balanced Distributed Full-Graph GNN Training with Tensor Parallelism

Summary: NeutronTP uses tensor parallelism for GNNs—partitioning node features (not graph) to remove cross-worker vertex dependencies and achieve load balance. A decoupled NN/aggregation framework plus memory-efficient, comm/comp-overlapping scheduling enables multi-GPU training and 1.29–8.72× speedups. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 13832
Venue: VLDB
Year: 2025
Pagerank: 4.3441378e-05
Overall Rank: 9,395 | 34.65%
DOI: 10.14778/3705829.3705837

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 3 of 3 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
10,066	DepCache: A KV Cache Management Framework for GraphRAG with Dependency Attention	2026	SIGMOD	4.1945683e-05
10,233	Efficient GNN Training on Giant Graphs with Collective Batching and Scheduling	2026	VLDB	4.1945683e-05
10,570	NeutronTask: Scalable and Efficient Multi-GPU GNN Training with Task Parallelism	2025	VLDB	4.1945683e-05

Outgoing Citations (Sorted by Pagerank)

Showing 8 of 8 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
278	AliGraph: A Comprehensive Graph Neural Network Platform	2019	VLDB	0.00029230623
1,160	Sancus: Staleness-Aware Communication-Avoiding Full-Graph Decentralized Training in Large-Scale Graph Neural Networks	2022	VLDB	0.00013586221
1,329	AGL: A Scalable System for Industrial-purpose Graph Machine Learning	2020	VLDB	0.00012561848
2,400	ByteGNN: Efficient Graph Neural Network Training at Large Scale	2022	VLDB	8.8955105e-05
3,025	NeutronStar: Distributed GNN Training with Hybrid Dependency Management	2022	SIGMOD	7.6906935e-05
3,087	Scalable and Efficient Full-Graph GNN Training for Large Graphs	2023	SIGMOD	7.5939896e-05
5,443	Decoupled Graph Neural Networks for Large Dynamic Graphs	2023	VLDB	5.5025808e-05
5,737	Comprehensive Evaluation of GNN Training Systems: A Data Management Perspective	2024	VLDB	5.3480667e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
5,737	Comprehensive Evaluation of GNN Training Systems: A Data Management Perspective	2024	VLDB	5.3480667e-05
9,596	Scalable Graph Convolutional Network Training on Distributed-Memory Systems	2023	VLDB	4.319218e-05
2,400	ByteGNN: Efficient Graph Neural Network Training at Large Scale	2022	VLDB	8.8955105e-05
5,345	NeutronStream: A Dynamic GNN Training Framework with Sliding Window for Graph Streams	2024	VLDB	5.5567697e-05
5,136	NeutronOrch: Rethinking Sample-based GNN Training under CPU-GPU Heterogeneous Environments	2024	VLDB	5.6723526e-05
3,087	Scalable and Efficient Full-Graph GNN Training for Large Graphs	2023	SIGMOD	7.5939896e-05
10,027	NeutronHeter: Optimizing Distributed Graph Neural Network Training for Heterogeneous Clusters	2026	SIGMOD	4.1945683e-05
3,025	NeutronStar: Distributed GNN Training with Hybrid Dependency Management	2022	SIGMOD	7.6906935e-05
10,298	NeutronCloud: Resource-Aware Distributed GNN Training in Fluctuating Cloud Environments	2026	VLDB	4.1945683e-05
10,570	NeutronTask: Scalable and Efficient Multi-GPU GNN Training with Task Parallelism	2025	VLDB	4.1945683e-05