Efficient Training of Graph Neural Networks on Large Graphs

Summary: Tutorial framing efficient GNN training on massive graphs via a data-management perspective across the graph lifecycle—preprocessing, batching, data transfer, and model training. Surveys DB techniques for static vs. dynamic graphs and pinpoints open research directions. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 13813
Venue: VLDB
Year: 2024
Pagerank: 5.8192133e-05
Overall Rank: 6,630 | 54.52%
DOI: 10.14778/3685800.3685844

Incoming Non-self Citations Over Time

Authors

1. Yanyan Shen (Shanghai Jiao Tong University)
2. Lei Chen (Hong Kong University of Science and Technology)
3. Jingzhi Fang (Hong Kong University of Science and Technology)
4. Xin Zhang (Hong Kong University of Science and Technology)
5. Shihong Gao (Hong Kong University of Science and Technology)
6. Hongbo Yin (Hong Kong University of Science and Technology)

BibTeX Citation

@article{shen_vldb24,
        title = {{Efficient Training of Graph Neural Networks on Large Graphs}},
        author = {Shen, Yanyan and Chen, Lei and Fang, Jingzhi and Zhang, Xin and Gao, Shihong and Yin, Hongbo},
        journal = {PVLDB},
        series = {{VLDB} '24},
        volume = {17},
        number = {12},
        pages = {4237--4240},
        doi = {10.14778/3685800.3685844},
        url = {https://doi.org/10.14778/3685800.3685844},
        year = {2024}
}

Incoming Citations (Sorted by Pagerank)

Showing 4 of 4 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
7,601	Systems for Scalable Graph Analytics and Machine Learning: Trends and Methods	2025	VLDB	5.5866563e-05
10,309	A Comprehensive Benchmark on Spectral GNNs: The Impact on Efficiency, Memory, and Effectiveness	2026	SIGMOD	5.093636e-05
10,323	NeutronHeter: Optimizing Distributed Graph Neural Network Training for Heterogeneous Clusters	2026	SIGMOD	5.093636e-05
10,835	NeutronTask: Scalable and Efficient Multi-GPU GNN Training with Task Parallelism	2025	VLDB	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 11 of 11 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
1,132	SANCUS: Staleness-Aware Communication-Avoiding Full-Graph Decentralized Training in Large-Scale Graph Neural Networks	2022	VLDB	0.00012041292
2,060	Traversing Large Graphs on GPUs with Unified Memory	2020	VLDB	9.2454783e-05
2,668	DUCATI: A Dual-Cache Training System for Graph Neural Networks on Giant Graphs with the GPU	2023	SIGMOD	8.2750247e-05
2,695	NeutronStar: Distributed GNN Training with Hybrid Dependency Management	2022	SIGMOD	8.2468134e-05
3,210	Zebra: When Temporal Graph Neural Networks Meet Temporal Personalized PageRank	2023	VLDB	7.6352864e-05
3,634	Orca: Scalable Temporal Graph Neural Network Training with Theoretical Guarantees	2023	SIGMOD	7.2358691e-05
5,079	NeutronOrch: Rethinking Sample-based GNN Training under CPU-GPU Heterogeneous Environments	2024	VLDB	6.3717342e-05
5,205	ETC: Efficient Training of Temporal Graph Neural Networks over Large-scale Dynamic Graphs	2024	VLDB	6.318626e-05
6,730	SIMPLE: Efficient Temporal Graph Neural Network Training at Scale with Dynamic Data Placement	2024	SIGMOD	5.7895038e-05
7,087	DAHA: Accelerating GNN Training with Data and Hardware Aware Execution Planning	2024	VLDB	5.7069166e-05
13,354	STile: Searching Hybrid Sparse Formats for Sparse Deep Learning Operators Automatically	2024	SIGMOD	-

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	4,980	Decoupled Graph Neural Networks for Large Dynamic Graphs	2023	VLDB
2	10,899	Can Graph Reordering Speed Up Graph Neural Network Training? An Experimental Study	2025	VLDB
3	10,975	Faster Convergence in Mini-batch Graph Neural Networks Training with Pseudo Full Neighborhood Compensation	2025	VLDB
4	3,751	G3: When Graph Neural Networks Meet Parallel Graph Processing Systems on GPUs	2020	VLDB
5	5,597	Accelerating Sampling and Aggregation Operations in GNN Frameworks with GPU Initiated Direct Storage Accesses	2024	VLDB
6	10,521	Efficient GNN Training on Giant Graphs with Collective Batching and Scheduling	2026	VLDB
7	10,811	Graph Neural Network Training Systems: A Performance Comparison of Full-Graph and Mini-Batch	2025	VLDB
8	1,863	ByteGNN: Efficient Graph Neural Network Training at Large Scale	2022	VLDB
9	2,640	Scalable and Efficient Full-Graph GNN Training for Large Graphs	2023	SIGMOD
10	5,316	Comprehensive Evaluation of GNN Training Systems: A Data Management Perspective	2024	VLDB