DBScholar

Back to papers

NeutronOrch: Rethinking Sample-based GNN Training under CPU-GPU Heterogeneous Environments

Summary: Diagnoses suboptimal CPU–GPU orchestration in sample-based GNN training and introduces layer-decoupled execution that pushes bottom-layer training to CPU to shrink GPU compute and memory footprint. NeutronOrch offloads only frequently accessed vertices with bounded-staleness embedding reuse and a fine-grained pipeline, achieving up to 11.51× speedup over prior systems. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID
h9853c2f6bf77f488
Venue
VLDB
Year
2024
Pagerank
6.3564568e-05
Overall Rank
4,884 | 67.27%
DOI
10.14778/3659437.3659453
PDF
Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{ai_vldb24,
        title = {{NeutronOrch: Rethinking Sample-based GNN Training under CPU-GPU Heterogeneous Environments}},
        author = {Ai, Xin and Wang, Qiange and Cao, Chunyu and Zhang, Yanfeng and Chen, Chaoyi and Yuan, Hao and Gu, Yu and Yu, Ge},
        journal = {PVLDB},
        series = {{VLDB} '24},
        volume = {17},
        number = {8},
        pages = {1995--2008},
        doi = {10.14778/3659437.3659453},
        url = {https://doi.org/10.14778/3659437.3659453},
        year = {2024}
}

Incoming Citations (Sorted by Pagerank)

Showing 9 of 9 citing papers.

Rank Citing Paper Year Venue Pagerank
6,686 Efficient Training of Graph Neural Networks on Large Graphs 2024 VLDB 5.6931383e-05
7,544 NeutronTask: Scalable and Efficient Multi-GPU GNN Training with Task Parallelism 2025 VLDB 5.4817498e-05
9,835 NeutronHeter: Optimizing Distributed Graph Neural Network Training for Heterogeneous Clusters 2026 SIGMOD 5.1064323e-05
10,292 Graph Neural Network Training Systems: A Performance Comparison of Full-Graph and Mini-Batch 2025 VLDB 5.031399e-05
10,404 NeutronSparse: Coordinating Heterogeneous Engines for Sparse Matrix Multiplication on NPUs 2027 SIGMOD 4.9605343e-05
10,597 A Comprehensive Benchmark on Spectral GNNs: The Impact on Efficiency, Memory, and Effectiveness 2026 SIGMOD 4.9605343e-05
10,777 Efficient GNN Training on Giant Graphs with Collective Batching and Scheduling 2026 VLDB 4.9605343e-05
10,897 FeLoG: Scalable and Efficient Distributed Graph Embedding with Feedback Loop Mechanism 2026 VLDB 4.9605343e-05
11,421 Faster Convergence in Mini-batch Graph Neural Networks Training with Pseudo Full Neighborhood Compensation 2025 VLDB 4.9605343e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 6 of 6 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
1,047 SANCUS: Staleness-Aware Communication-Avoiding Full-Graph Decentralized Training in Large-Scale Graph Neural Networks 2022 VLDB 0.00012313386
1,223 Large Graph Convolutional Network Training with GPU-Oriented Data Communication Architecture 2021 VLDB 0.00011439503
2,273 NeutronStar: Distributed GNN Training with Hybrid Dependency Management 2022 SIGMOD 8.7079974e-05
2,513 DUCATI: A Dual-Cache Training System for Graph Neural Networks on Giant Graphs with the GPU 2023 SIGMOD 8.3467757e-05
2,825 Saga: A Platform for Continuous Construction and Serving of Knowledge At Scale 2022 SIGMOD 7.9503483e-05
5,359 FreshGNN: Reducing Memory Access via Stable Historical Embeddings for Graph Neural Network Training 2024 VLDB 6.1498425e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 3,706 G3: When Graph Neural Networks Meet Parallel Graph Processing Systems on GPUs 2020 VLDB
2 4,848 Accelerating Sampling and Aggregation Operations in GNN Frameworks with GPU Initiated Direct Storage Accesses 2024 VLDB
3 10,777 Efficient GNN Training on Giant Graphs with Collective Batching and Scheduling 2026 VLDB
4 7,036 Can Graph Reordering Speed Up Graph Neural Network Training? An Experimental Study 2025 VLDB
5 4,524 NeutronStream: A Dynamic GNN Training Framework with Sliding Window for Graph Streams 2024 VLDB
6 2,273 NeutronStar: Distributed GNN Training with Hybrid Dependency Management 2022 SIGMOD
7 11,113 NeutronCloud: Resource-Aware Distributed GNN Training in Fluctuating Cloud Environments 2026 VLDB
8 8,174 NeutronTP: Load-Balanced Distributed Full-Graph GNN Training with Tensor Parallelism 2025 VLDB
9 9,835 NeutronHeter: Optimizing Distributed Graph Neural Network Training for Heterogeneous Clusters 2026 SIGMOD
10 7,544 NeutronTask: Scalable and Efficient Multi-GPU GNN Training with Task Parallelism 2025 VLDB