Distributed Learning of Fully Connected Neural Networks using Independent Subnet Training

Summary: Independent Subnet Training (IST) partitions a FCN into narrow subnetworks trained locally; rounds exchange params to form new subnets. Model-parallel, local-subnet training reduces memory, avoids data sharing, lowers communication, and speeds training. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 12663
Venue: VLDB
Year: 2022
Pagerank: 4.2269436e-05
Overall Rank: 9,965 | 30.68%
DOI: 10.14778/3529337.3529343

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 1 of 1 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
9,806	The Image Calculator: 10x Faster Image-AI Inference by Replacing JPEG with Self-designing Storage Format	2024	SIGMOD	4.2805224e-05

Outgoing Citations (Sorted by Pagerank)

Showing 1 of 1 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
1,044	DimmWitted: A Study of Main-Memory Statistical Analytics	2014	VLDB	0.00014475229

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
10,027	NeutronHeter: Optimizing Distributed Graph Neural Network Training for Heterogeneous Clusters	2026	SIGMOD	4.1945683e-05
2,400	ByteGNN: Efficient Graph Neural Network Training at Large Scale	2022	VLDB	8.8955105e-05
9,170	MemFlow: Memory-Aware Distributed Deep Learning	2020	SIGMOD	4.3849075e-05
10,656	Effective and Efficient Distributed Temporal Graph Learning through Hotspot Memory Sharing	2025	VLDB	4.1945683e-05
9,395	NeutronTP: Load-Balanced Distributed Full-Graph GNN Training with Tensor Parallelism	2025	VLDB	4.3441378e-05
10,298	NeutronCloud: Resource-Aware Distributed GNN Training in Fluctuating Cloud Environments	2026	VLDB	4.1945683e-05
3,087	Scalable and Efficient Full-Graph GNN Training for Large Graphs	2023	SIGMOD	7.5939896e-05
411	PyTorch Distributed: Experiences on Accelerating Data Parallel Training	2020	VLDB	0.00023906921
5,333	Heterogeneity-Aware Distributed Machine Learning Training via Partial Reduce	2021	SIGMOD	5.5656575e-05
9,596	Scalable Graph Convolutional Network Training on Distributed-Memory Systems	2023	VLDB	4.319218e-05