HongTu: Scalable Full-Graph GNN Training on Multiple GPUs

Summary: HongTu scales full-graph GNN training on multi-GPU platforms with CPU-memory vertex storage, GPU offload, and recomputation caching. It minimizes host-GPU traffic with deduplicated communication and cost-guided reorganization, and delivers speedups over DistGNN. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h389a703125658dae
Venue: SIGMOD
Year: 2023
Pagerank: 5.6213095e-05
Overall Rank: 6,947 | 53.44%
DOI: 10.1145/3626733
PDF: Download (CC BY 4.0)

Incoming Non-self Citations Over Time

Authors

1. Qiange Wang (National University of Singapore)
2. Yao Chen (National University of Singapore)
3. Weng-Fai Wong (National University of Singapore)
4. Bingsheng He (National University of Singapore)

BibTeX Citation

@inproceedings{wang_sigmod23,
        title = {{HongTu: Scalable Full-Graph GNN Training on Multiple GPUs}},
        author = {Wang, Qiange and Chen, Yao and Wong, Weng-Fai and He, Bingsheng},
        series = {{SIGMOD} '23},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3626733},
        url = {https://dl.acm.org/doi/10.1145/3626733},
        year = {2023}
}

Incoming Citations (Sorted by Pagerank)

Showing 10 of 10 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
6,944	DepCache: A KV Cache Management Framework for GraphRAG with Dependency Attention	2026	SIGMOD	5.6219388e-05
7,544	NeutronTask: Scalable and Efficient Multi-GPU GNN Training with Task Parallelism	2025	VLDB	5.4817498e-05
7,729	Systems for Scalable Graph Analytics and Machine Learning: Trends and Methods	2025	VLDB	5.4511876e-05
9,835	NeutronHeter: Optimizing Distributed Graph Neural Network Training for Heterogeneous Clusters	2026	SIGMOD	5.1064323e-05
10,292	Graph Neural Network Training Systems: A Performance Comparison of Full-Graph and Mini-Batch	2025	VLDB	5.031399e-05
10,306	Improving Graph Compression for Efficient Resource-Constrained Graph Analytics	2024	VLDB	5.0294306e-05
10,404	NeutronSparse: Coordinating Heterogeneous Engines for Sparse Matrix Multiplication on NPUs	2027	SIGMOD	4.9605343e-05
10,856	MGI: A Communication Framework for Data Processing in Massive GPU Infrastructures	2026	VLDB	4.9605343e-05
11,113	NeutronCloud: Resource-Aware Distributed GNN Training in Fluctuating Cloud Environments	2026	VLDB	4.9605343e-05
11,421	Faster Convergence in Mini-batch Graph Neural Networks Training with Pseudo Full Neighborhood Compensation	2025	VLDB	4.9605343e-05

Outgoing Citations (Sorted by Pagerank)

Showing 8 of 8 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
203	AliGraph: A Comprehensive Graph Neural Network Platform	2019	VLDB	0.00025234479
1,047	SANCUS: Staleness-Aware Communication-Avoiding Full-Graph Decentralized Training in Large-Scale Graph Neural Networks	2022	VLDB	0.00012313386
1,223	Large Graph Convolutional Network Training with GPU-Oriented Data Communication Architecture	2021	VLDB	0.00011439503
1,530	Pipelined Query Processing in Coprocessor Environments	2018	SIGMOD	0.00010318943
1,537	HippogriffDB: Balancing I/O and GPU Bandwidth in Big Data Analytics	2016	VLDB	0.00010296073
2,273	NeutronStar: Distributed GNN Training with Hybrid Dependency Management	2022	SIGMOD	8.7079974e-05
4,436	LargeEA: Aligning Entities for Large-scale Knowledge Graphs	2022	VLDB	6.5848584e-05
5,543	EMOGI: Efficient Memory-access for Out-of-memory Graph-traversal in GPUs	2021	VLDB	6.0730939e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	6,686	Efficient Training of Graph Neural Networks on Large Graphs	2024	VLDB
2	8,174	NeutronTP: Load-Balanced Distributed Full-Graph GNN Training with Tensor Parallelism	2025	VLDB
3	1,780	ByteGNN: Efficient Graph Neural Network Training at Large Scale	2022	VLDB
4	3,706	G3: When Graph Neural Networks Meet Parallel Graph Processing Systems on GPUs	2020	VLDB
5	4,875	Comprehensive Evaluation of GNN Training Systems: A Data Management Perspective	2024	VLDB
6	7,544	NeutronTask: Scalable and Efficient Multi-GPU GNN Training with Task Parallelism	2025	VLDB
7	1,223	Large Graph Convolutional Network Training with GPU-Oriented Data Communication Architecture	2021	VLDB
8	6,815	XGNN: Boosting Multi-GPU GNN Training via Global GNN Memory Store	2024	VLDB
9	9,942	Scalable Graph Convolutional Network Training on Distributed-Memory Systems	2023	VLDB
10	2,325	Scalable and Efficient Full-Graph GNN Training for Large Graphs	2023	SIGMOD