Efficient Training of Graph Neural Networks on Large Graphs

Summary: Tutorial framing efficient GNN training on massive graphs via a data-management perspective across the graph lifecycle—preprocessing, batching, data transfer, and model training. Surveys DB techniques for static vs. dynamic graphs and pinpoints open research directions. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: ha36eb250ed217c82
Venue: VLDB
Year: 2024
Pagerank: 5.7147311e-05
Overall Rank: 6,669 | 55.17%
DOI: 10.14778/3685800.3685844

Incoming Non-self Citations Over Time

Authors

1. Yanyan Shen (Shanghai Jiao Tong University)
2. Lei Chen (Hong Kong University of Science and Technology)
3. Jingzhi Fang (Hong Kong University of Science and Technology)
4. Xin Zhang (Hong Kong University of Science and Technology)
5. Shihong Gao (Hong Kong University of Science and Technology)
6. Hongbo Yin (Hong Kong University of Science and Technology)

BibTeX Citation

@article{shen_vldb24,
        title = {{Efficient Training of Graph Neural Networks on Large Graphs}},
        author = {Shen, Yanyan and Chen, Lei and Fang, Jingzhi and Zhang, Xin and Gao, Shihong and Yin, Hongbo},
        journal = {PVLDB},
        series = {{VLDB} '24},
        volume = {17},
        number = {12},
        pages = {4237--4240},
        doi = {10.14778/3685800.3685844},
        url = {https://doi.org/10.14778/3685800.3685844},
        year = {2024}
}

Incoming Citations (Sorted by Pagerank)

Showing 5 of 5 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
7,522	NeutronTask: Scalable and Efficient Multi-GPU GNN Training with Task Parallelism	2025	VLDB	5.5025409e-05
7,708	Systems for Scalable Graph Analytics and Machine Learning: Trends and Methods	2025	VLDB	5.4718627e-05
9,795	NeutronHeter: Optimizing Distributed Graph Neural Network Training for Heterogeneous Clusters	2026	SIGMOD	5.1257999e-05
10,520	A Comprehensive Benchmark on Spectral GNNs: The Impact on Efficiency, Memory, and Effectiveness	2026	SIGMOD	4.9793485e-05
13,610	Graph Foundation Models: State of the Art and Future Directions	2026	VLDB	-

Outgoing Citations (Sorted by Pagerank)

Showing 11 of 11 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
1,134	SANCUS: Staleness-Aware Communication-Avoiding Full-Graph Decentralized Training in Large-Scale Graph Neural Networks	2022	VLDB	0.00011893521
2,068	Traversing Large Graphs on GPUs with Unified Memory	2020	VLDB	9.0920811e-05
2,279	NeutronStar: Distributed GNN Training with Hybrid Dependency Management	2022	SIGMOD	8.7062637e-05
2,506	DUCATI: A Dual-Cache Training System for Graph Neural Networks on Giant Graphs with the GPU	2023	SIGMOD	8.3774747e-05
3,017	Zebra: When Temporal Graph Neural Networks Meet Temporal Personalized PageRank	2023	VLDB	7.7471344e-05
3,399	Orca: Scalable Temporal Graph Neural Network Training with Theoretical Guarantees	2023	SIGMOD	7.3349076e-05
4,764	ETC: Efficient Training of Temporal Graph Neural Networks over Large-scale Dynamic Graphs	2024	VLDB	6.4276208e-05
4,825	DAHA: Accelerating GNN Training with Data and Hardware Aware Execution Planning	2024	VLDB	6.3923554e-05
4,853	NeutronOrch: Rethinking Sample-based GNN Training under CPU-GPU Heterogeneous Environments	2024	VLDB	6.3805655e-05
6,826	SIMPLE: Efficient Temporal Graph Neural Network Training at Scale with Dynamic Data Placement	2024	SIGMOD	5.6700316e-05
13,671	STile: Searching Hybrid Sparse Formats for Sparse Deep Learning Operators Automatically	2024	SIGMOD	-

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	5,051	Decoupled Graph Neural Networks for Large Dynamic Graphs	2023	VLDB
2	9,233	Can Graph Reordering Speed Up Graph Neural Network Training? An Experimental Study	2025	VLDB
3	11,361	Faster Convergence in Mini-batch Graph Neural Networks Training with Pseudo Full Neighborhood Compensation	2025	VLDB
4	3,752	G3: When Graph Neural Networks Meet Parallel Graph Processing Systems on GPUs	2020	VLDB
5	4,826	Accelerating Sampling and Aggregation Operations in GNN Frameworks with GPU Initiated Direct Storage Accesses	2024	VLDB
6	10,706	Efficient GNN Training on Giant Graphs with Collective Batching and Scheduling	2026	VLDB
7	10,257	Graph Neural Network Training Systems: A Performance Comparison of Full-Graph and Mini-Batch	2025	VLDB
8	1,772	ByteGNN: Efficient Graph Neural Network Training at Large Scale	2022	VLDB
9	2,596	Scalable and Efficient Full-Graph GNN Training for Large Graphs	2023	SIGMOD
10	4,898	Comprehensive Evaluation of GNN Training Systems: A Data Management Perspective	2024	VLDB