NeutronOrch: Rethinking Sample-based GNN Training under CPU-GPU Heterogeneous Environments

Summary: Diagnoses suboptimal CPU–GPU orchestration in sample-based GNN training and introduces layer-decoupled execution that pushes bottom-layer training to CPU to shrink GPU compute and memory footprint. NeutronOrch offloads only frequently accessed vertices with bounded-staleness embedding reuse and a fine-grained pipeline, achieving up to 11.51× speedup over prior systems. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 13434
Venue: VLDB
Year: 2024
Pagerank: 5.6723526e-05
Overall Rank: 5,136 | 64.28%
DOI: 10.14778/3659437.3659453

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 7 of 7 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
6,942	Efficient Training of Graph Neural Networks on Large Graphs	2024	VLDB	4.8922884e-05
10,011	A Comprehensive Benchmark on Spectral GNNs: The Impact on Efficiency, Memory, and Effectiveness	2026	SIGMOD	4.1945683e-05
10,027	NeutronHeter: Optimizing Distributed Graph Neural Network Training for Heterogeneous Clusters	2026	SIGMOD	4.1945683e-05
10,233	Efficient GNN Training on Giant Graphs with Collective Batching and Scheduling	2026	VLDB	4.1945683e-05
10,539	Graph Neural Network Training Systems: A Performance Comparison of Full-Graph and Mini-Batch.	2025	VLDB	4.1945683e-05
10,570	NeutronTask: Scalable and Efficient Multi-GPU GNN Training with Task Parallelism	2025	VLDB	4.1945683e-05
10,735	Faster Convergence in Mini-batch Graph Neural Networks Training with Pseudo Full Neighborhood Compensation	2025	VLDB	4.1945683e-05

Outgoing Citations (Sorted by Pagerank)

Showing 6 of 6 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
1,103	Large Graph Convolutional Network Training with GPU-Oriented Data Communication Architecture	2021	VLDB	0.00014025101
1,160	Sancus: Staleness-Aware Communication-Avoiding Full-Graph Decentralized Training in Large-Scale Graph Neural Networks	2022	VLDB	0.00013586221
2,422	DUCATI: A Dual-Cache Training System for Graph Neural Networks on Giant Graphs with the GPU	2023	SIGMOD	8.8499665e-05
3,025	NeutronStar: Distributed GNN Training with Hybrid Dependency Management	2022	SIGMOD	7.6906935e-05
3,711	Saga: A Platform for Continuous Construction and Serving of Knowledge At Scale	2022	SIGMOD	6.823609e-05
5,321	FreshGNN: Reducing Memory Access via Stable Historical Embeddings for Graph Neural Network Training	2024	VLDB	5.5710441e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
3,986	G3: When Graph Neural Networks Meet Parallel Graph Processing Systems on GPUs	2020	VLDB	6.5611714e-05
5,561	Accelerating Sampling and Aggregation Operations in GNN Frameworks with GPU Initiated Direct Storage Accesses	2024	VLDB	5.4332062e-05
10,233	Efficient GNN Training on Giant Graphs with Collective Batching and Scheduling	2026	VLDB	4.1945683e-05
10,647	Can Graph Reordering Speed Up Graph Neural Network Training? An Experimental Study	2025	VLDB	4.1945683e-05
5,345	NeutronStream: A Dynamic GNN Training Framework with Sliding Window for Graph Streams	2024	VLDB	5.5567697e-05
3,025	NeutronStar: Distributed GNN Training with Hybrid Dependency Management	2022	SIGMOD	7.6906935e-05
10,298	NeutronCloud: Resource-Aware Distributed GNN Training in Fluctuating Cloud Environments	2026	VLDB	4.1945683e-05
9,395	NeutronTP: Load-Balanced Distributed Full-Graph GNN Training with Tensor Parallelism	2025	VLDB	4.3441378e-05
10,027	NeutronHeter: Optimizing Distributed Graph Neural Network Training for Heterogeneous Clusters	2026	SIGMOD	4.1945683e-05
10,570	NeutronTask: Scalable and Efficient Multi-GPU GNN Training with Task Parallelism	2025	VLDB	4.1945683e-05