DBScholar

Back to papers

Faster Convergence in Mini-batch Graph Neural Networks Training with Pseudo Full Neighborhood Compensation

Summary: Identifies two gradient-estimation error sources in mini-batch neighbor-sampled GNNs—missing contributions from unsampled target nodes and inaccuracies in sampled-node messages—and shows prior work largely ignores the former. Proposes PFNC: a history-based, partial-cache, sampler-agnostic compensation scheme that corrects both errors, provably better approximates full-batch gradients, and empirically speeds convergence and improves generalization. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID
14235
Venue
VLDB
Year
2025
Pagerank
5.093636e-05
Overall Rank
10,975 | 24.71%
DOI
10.14778/3749646.3749695

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

BibTeX Citation

@article{zhou_vldb25,
        title = {{Faster Convergence in Mini-batch Graph Neural Networks Training with Pseudo Full Neighborhood Compensation}},
        author = {Zhou, Qiqi and Shen, Yanyan and Chen, Lei},
        journal = {PVLDB},
        series = {{VLDB} '25},
        volume = {18},
        number = {11},
        pages = {4309--4322},
        doi = {10.14778/3749646.3749695},
        url = {https://doi.org/10.14778/3749646.3749695},
        year = {2025}
}

Incoming Citations (Sorted by Pagerank)

Showing 1 of 1 citing papers.

Rank Citing Paper Year Venue Pagerank
10,521 Efficient GNN Training on Giant Graphs with Collective Batching and Scheduling 2026 VLDB 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 17 of 17 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
223 AliGraph: A Comprehensive Graph Neural Network Platform 2019 VLDB 0.00024182473
1,132 SANCUS: Staleness-Aware Communication-Avoiding Full-Graph Decentralized Training in Large-Scale Graph Neural Networks 2022 VLDB 0.00012041292
2,640 Scalable and Efficient Full-Graph GNN Training for Large Graphs 2023 SIGMOD 8.3074486e-05
2,668 DUCATI: A Dual-Cache Training System for Graph Neural Networks on Giant Graphs with the GPU 2023 SIGMOD 8.2750247e-05
4,878 NeutronStream: A Dynamic GNN Training Framework with Sliding Window for Graph Streams 2024 VLDB 6.4684388e-05
4,891 DGC: Training Dynamic Graphs with Spatio-Temporal Non-Uniformity using Graph Partitioning by Chunks 2023 SIGMOD 6.4581865e-05
5,079 NeutronOrch: Rethinking Sample-based GNN Training under CPU-GPU Heterogeneous Environments 2024 VLDB 6.3717342e-05
5,205 ETC: Efficient Training of Temporal Graph Neural Networks over Large-scale Dynamic Graphs 2024 VLDB 6.318626e-05
5,243 FreshGNN: Reducing Memory Access via Stable Historical Embeddings for Graph Neural Network Training 2024 VLDB 6.3018825e-05
5,316 Comprehensive Evaluation of GNN Training Systems: A Data Management Perspective 2024 VLDB 6.2687017e-05
5,760 DynaHB: A Communication-Avoiding Asynchronous Distributed Framework with Hybrid Batches for Dynamic GNN Training 2024 VLDB 6.0961929e-05
6,588 Lotan: Bridging the Gap between GNNs and Scalable Graph Analytics Engines 2023 VLDB 5.833338e-05
6,652 Eliminating Data Processing Bottlenecks in GNN Training over Large Graphs via Two-level Feature Compression 2024 VLDB 5.8139657e-05
6,730 SIMPLE: Efficient Temporal Graph Neural Network Training at Scale with Dynamic Data Placement 2024 SIGMOD 5.7895038e-05
6,806 HongTu: Scalable Full-Graph GNN Training on Multiple GPUs 2023 SIGMOD 5.7673207e-05
7,087 DAHA: Accelerating GNN Training with Data and Hardware Aware Execution Planning 2024 VLDB 5.7069166e-05
7,374 ADGNN: Towards Scalable GNN Training with Aggregation-Difference Aware Sampling 2023 SIGMOD 5.6306367e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 1,863 ByteGNN: Efficient Graph Neural Network Training at Large Scale 2022 VLDB
2 7,374 ADGNN: Towards Scalable GNN Training with Aggregation-Difference Aware Sampling 2023 SIGMOD
3 6,652 Eliminating Data Processing Bottlenecks in GNN Training over Large Graphs via Two-level Feature Compression 2024 VLDB
4 8,912 Historical Embedding-Guided Efficient Large-Scale Federated Graph Learning 2024 SIGMOD
5 6,261 EARLY: Efficient and Reliable Graph Neural Network for Dynamic Graphs 2023 SIGMOD
6 5,243 FreshGNN: Reducing Memory Access via Stable Historical Embeddings for Graph Neural Network Training 2024 VLDB
7 5,316 Comprehensive Evaluation of GNN Training Systems: A Data Management Perspective 2024 VLDB
8 2,640 Scalable and Efficient Full-Graph GNN Training for Large Graphs 2023 SIGMOD
9 6,630 Efficient Training of Graph Neural Networks on Large Graphs 2024 VLDB
10 10,811 Graph Neural Network Training Systems: A Performance Comparison of Full-Graph and Mini-Batch 2025 VLDB