Database Paper Browser

Back to papers

FastFlow: Accelerating Deep Learning Model Training with Smart Offloading of Input Data Pipeline

Summary: FastFlow automatically mitigates CPU-side input-pipeline bottlenecks by smartly offloading preprocessing to remote CPUs and jointly leveraging local+remote resources to maximize GPU utilization. Integrated into TensorFlow, its performance-driven offloading policy yields 1–4.5× throughput gains vs TensorFlow/tf.data.service and up to 2.06× vs DALI. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID
12978
Venue
VLDB
Year
2023
Pagerank
6.3793352e-05
Overall Rank
4,180 | 70.93%
DOI
10.14778/3579075.3579083

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 9 of 9 citing papers.

Rank Citing Paper Year Venue Pagerank
3,995 How Large Language Models Will Disrupt Data Management 2023 VLDB 6.5513237e-05
5,993 DLRover-RM: Resource Optimization for Deep Recommendation Models Training in the Cloud 2024 VLDB 5.2415551e-05
8,348 FusionFlow: Accelerating Data Preprocessing for Machine Learning with CPU-GPU Cooperation 2024 VLDB 4.5410024e-05
8,735 TensorSocket: Shared Data Loading for Deep Learning Training 2026 SIGMOD 4.456315e-05
8,737 Scheduling Data Processing Pipelines for Incremental Training on MLP-based Recommendation Models 2025 SIGMOD 4.456315e-05
9,677 Apt-Serve: Adaptive Request Scheduling on Hybrid Cache for Scalable LLM Inference Serving 2025 SIGMOD 4.3047774e-05
9,805 MEMO: Fine-grained Tensor Management For Ultra-long Context LLM Training 2025 SIGMOD 4.2805224e-05
10,580 GPEmu: A GPU Emulator for Faster and Cheaper Prototyping and Evaluation of Deep Learning System Research 2025 VLDB 4.1945683e-05
10,770 cedar: Optimized and Unified Machine Learning Input Data Pipelines 2025 VLDB 4.1945683e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 4 of 4 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
1,504 Analyzing and Mitigating Data Stalls in DNN Training 2021 VLDB 0.00011642333
2,170 tf.data: A Machine Learning Data Processing Framework 2021 VLDB 9.3821603e-05
3,698 Where Is My Training Bottleneck? Hidden Trade-Offs in Deep Learning Preprocessing Pipelines 2022 SIGMOD 6.8340435e-05
6,057 Progressive Compressed Records: Taking a Byte out of Deep Learning Data 2021 VLDB 5.2317752e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

Overall Rank Paper Year Venue Pagerank
1,504 Analyzing and Mitigating Data Stalls in DNN Training 2021 VLDB 0.00011642333
10,285 Resilience-Aware Elastic Scaling for Cloud-Native Online DL Training on Multi-Tenant GPU Clusters 2026 VLDB 4.1945683e-05
5,552 GoldMiner: Elastic Scaling of Training Data Pre-Processing Pipelines for Deep Learning 2023 SIGMOD 5.4402488e-05
6,377 Galvatron: Efficient Transformer Training over Multiple GPUs Using Automatic Parallelism 2023 VLDB 5.0911095e-05
9,170 MemFlow: Memory-Aware Distributed Deep Learning 2020 SIGMOD 4.3849075e-05
3,363 CROSSBOW: Scaling Deep Learning with Small Batch Sizes on Multi-GPU Servers 2019 VLDB 7.1731921e-05
8,735 TensorSocket: Shared Data Loading for Deep Learning Training 2026 SIGMOD 4.456315e-05
2,170 tf.data: A Machine Learning Data Processing Framework 2021 VLDB 9.3821603e-05
3,698 Where Is My Training Bottleneck? Hidden Trade-Offs in Deep Learning Preprocessing Pipelines 2022 SIGMOD 6.8340435e-05
8,348 FusionFlow: Accelerating Data Preprocessing for Machine Learning with CPU-GPU Cooperation 2024 VLDB 4.5410024e-05