Database Paper Browser

Back to papers

MemFlow: Memory-Aware Distributed Deep Learning

Summary: MemFlow is a memory-aware distributed DNN optimizer that jointly optimizes memory usage vs training time to yield Pareto configs. It builds a memory-estimated task graph, simulates parallelism, and uses MCMC to explore recomputation vs compute tradeoffs. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
5848
Venue
SIGMOD
Year
2020
Pagerank
4.3849075e-05
Overall Rank
9,170 | 36.21%
DOI
10.1145/3318464.3384416

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 2 of 2 citing papers.

Rank Citing Paper Year Venue Pagerank
8,346 Deep Learning: Systems and Responsibility 2021 SIGMOD 4.5420668e-05
9,596 Scalable Graph Convolutional Network Training on Distributed-Memory Systems 2023 VLDB 4.319218e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 0 of 0 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
Previous Page 1 / 1 Next

Semantically Similar Papers

Overall Rank Paper Year Venue Pagerank
10,634 PipeTGL: (Near) Zero Bubble Memory-based Temporal Graph Neural Network Training via Pipeline Optimization 2025 VLDB 4.1945683e-05
8,808 FlexMoE: Scaling Large-scale Sparse Pre-trained Model Training via Dynamic Device Placement 2023 SIGMOD 4.4454035e-05
7,372 Model-Free Control for Distributed Stream Data Processing using Deep Reinforcement Learning 2018 VLDB 4.7496881e-05
8,463 D3-GNN: Dynamic Distributed Dataflow for Streaming Graph Neural Networks 2024 VLDB 4.5052127e-05
9,965 Distributed Learning of Fully Connected Neural Networks using Independent Subnet Training 2022 VLDB 4.2269436e-05
4,180 FastFlow: Accelerating Deep Learning Model Training with Smart Offloading of Input Data Pipeline 2023 VLDB 6.3793352e-05
1,953 Distributed Evaluation of Subgraph Queries Using Worst-case Optimal Low-Memory Dataflows 2018 VLDB 9.9665955e-05
9,805 MEMO: Fine-grained Tensor Management For Ultra-long Context LLM Training 2025 SIGMOD 4.2805224e-05
9,596 Scalable Graph Convolutional Network Training on Distributed-Memory Systems 2023 VLDB 4.319218e-05
10,656 Effective and Efficient Distributed Temporal Graph Learning through Hotspot Memory Sharing 2025 VLDB 4.1945683e-05