Database Paper Browser

Back to papers

MemFlow: Memory-Aware Distributed Deep Learning

Summary: MemFlow is a memory-aware distributed DNN optimizer that jointly optimizes memory usage vs training time to yield Pareto configs. It builds a memory-estimated task graph, simulates parallelism, and uses MCMC to explore recomputation vs compute tradeoffs. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
5849
Venue
SIGMOD
Year
2020
Pagerank
5.3868654e-05
Overall Rank
9,083 | 36.88%
DOI
10.1145/3318464.3384416

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 2 of 2 citing papers.

Rank Citing Paper Year Venue Pagerank
8,194 Deep Learning: Systems and Responsibility 2021 SIGMOD 5.5370263e-05
9,584 Scalable Graph Convolutional Network Training on Distributed-Memory Systems 2023 VLDB 5.3099516e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 0 of 0 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
Previous Page 1 / 1 Next

Semantically Similar Papers

Overall Rank Paper Year Venue Pagerank
10,642 PipeTGL: (Near) Zero Bubble Memory-based Temporal Graph Neural Network Training via Pipeline Optimization 2025 VLDB 5.1725247e-05
8,758 FlexMoE: Scaling Large-scale Sparse Pre-trained Model Training via Dynamic Device Placement 2023 SIGMOD 5.4339232e-05
7,076 Model-Free Control for Distributed Stream Data Processing using Deep Reinforcement Learning 2018 VLDB 5.7629614e-05
8,328 D3-GNN: Dynamic Distributed Dataflow for Streaming Graph Neural Networks 2024 VLDB 5.5065836e-05
9,964 Distributed Learning of Fully Connected Neural Networks using Independent Subnet Training 2022 VLDB 5.2113068e-05
3,715 FastFlow: Accelerating Deep Learning Model Training with Smart Offloading of Input Data Pipeline 2023 VLDB 7.243454e-05
1,336 Distributed Evaluation of Subgraph Queries Using Worst-case Optimal Low-Memory Dataflows 2018 VLDB 0.00011216887
9,777 MEMO: Fine-grained Tensor Management For Ultra-long Context LLM Training 2025 SIGMOD 5.2743647e-05
9,584 Scalable Graph Convolutional Network Training on Distributed-Memory Systems 2023 VLDB 5.3099516e-05
10,664 Effective and Efficient Distributed Temporal Graph Learning through Hotspot Memory Sharing 2025 VLDB 5.1725247e-05