TensorSocket: Shared Data Loading for Deep Learning Training

Summary: TensorSocket enables collocated DL training processes to share a single data loader, removing redundant CPU preprocessing and data copies while leveraging GPU–GPU interconnects to serve batches directly. Pipeline- and hardware-agnostic, supports heterogeneous models/batch sizes, yields up to 2× throughput and ~50% cloud CPU cost savings, and outperforms CoorDL and Joader. (summarized by gpt-5-mini on Feb 11 2026)

Paper ID: 7343
Venue: SIGMOD
Year: 2026
Pagerank: 4.4520434e-05
Overall Rank: 8,731 | 39.32%
DOI: 10.1145/3749185

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 1 of 1 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
10,183	Mixtera: A Data Plane for Foundation Model Training	2026	SIGMOD	4.1905499e-05

Outgoing Citations (Sorted by Pagerank)

Showing 13 of 13 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
515	QPipe: A Simultaneously Pipelined Relational Query Engine	2005	SIGMOD	0.00021209491
684	Cerebro: A Data System for Optimized Deep Learning Model Selection	2020	VLDB	0.00018152321
934	SharedDB: Killing One Thousand Queries With One Stone	2012	VLDB	0.00015201246
1,500	Analyzing and Mitigating Data Stalls in DNN Training	2021	VLDB	0.00011636174
2,175	tf.data: A Machine Learning Data Processing Framework	2021	VLDB	9.3745231e-05
3,372	CROSSBOW: Scaling Deep Learning with Small Batch Sizes on Multi-GPU Servers	2019	VLDB	7.1633912e-05
3,694	Where Is My Training Bottleneck? Hidden Trade-Offs in Deep Learning Preprocessing Pipelines	2022	SIGMOD	6.8316905e-05
4,175	FastFlow: Accelerating Deep Learning Model Training with Smart Offloading of Input Data Pipeline	2023	VLDB	6.3772575e-05
4,677	To Share or Not to Share?	2007	VLDB	5.9988869e-05
4,964	Sharing Data and Work Across Concurrent Analytical Queries	2013	VLDB	5.7974073e-05
6,507	Expand your Training Limits! Generating Training Data for ML-based Data Management	2021	SIGMOD	5.0273414e-05
8,261	ADDICT: Advanced Instruction Chasing for Transactions	2014	VLDB	4.5420317e-05
8,343	FusionFlow: Accelerating Data Preprocessing for Machine Learning with CPU-GPU Cooperation	2024	VLDB	4.5366487e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
4,700	Tensors: An abstraction for general data processing	2021	VLDB	5.9810592e-05
1,102	Large Graph Convolutional Network Training with GPU-Oriented Data Communication Architecture	2021	VLDB	0.00014011556
9,596	Scalable Graph Convolutional Network Training on Distributed-Memory Systems	2023	VLDB	4.3150788e-05
1,500	Analyzing and Mitigating Data Stalls in DNN Training	2021	VLDB	0.00011636174
8,343	FusionFlow: Accelerating Data Preprocessing for Machine Learning with CPU-GPU Cooperation	2024	VLDB	4.5366487e-05
2,175	tf.data: A Machine Learning Data Processing Framework	2021	VLDB	9.3745231e-05
3,694	Where Is My Training Bottleneck? Hidden Trade-Offs in Deep Learning Preprocessing Pipelines	2022	SIGMOD	6.8316905e-05
2,907	PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel	2023	VLDB	7.9322286e-05
411	PyTorch Distributed: Experiences on Accelerating Data Parallel Training	2020	VLDB	0.00023881138
4,175	FastFlow: Accelerating Deep Learning Model Training with Smart Offloading of Input Data Pipeline	2023	VLDB	6.3772575e-05