DBScholar

Back to papers

Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches

Summary: Compares four ways to integrate Model Hopper Parallelism for deep learning over DB-resident data, prototyped in Greenplum. Finds a Pareto frontier: 3–6× runtime gains can trade off governance, portability, and operational simplicity. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
h7b85e55aba3296c0
Venue
VLDB
Year
2021
Pagerank
6.8064316e-05
Overall Rank
4,097 | 72.47%
DOI
10.14778/3467861.3467867
PDF
Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{zhang_vldb21,
        title = {{Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches}},
        author = {Zhang, Yuhao and McQuillan, Frank and Jayaram, Nandish and Kak, Nikhil and Khanna, Ekta and Kislal, Orhan and Valdano, Domino and Kumar, Arun},
        journal = {PVLDB},
        series = {{VLDB} '21},
        volume = {14},
        number = {10},
        pages = {1769--1782},
        doi = {10.14778/3467861.3467867},
        url = {https://doi.org/10.14778/3467861.3467867},
        year = {2021}
}

Incoming Citations (Sorted by Pagerank)

Showing 14 of 14 citing papers.

Rank Citing Paper Year Venue Pagerank
2,661 End-to-end Optimization of Machine Learning Prediction Queries 2022 SIGMOD 8.1568473e-05
3,645 User-Defined Operators: Efficiently Integrating Custom Algorithms into Modern Databases 2022 VLDB 7.1383149e-05
5,271 InferDB: In-Database Machine Learning Inference Using Indexes 2024 VLDB 6.1991633e-05
5,778 The Tensor Data Platform: Towards an AI-centric Database System 2023 CIDR 5.9953658e-05
5,901 Lotan: Bridging the Gap between GNNs and Scalable Graph Analytics Engines 2023 VLDB 5.9517243e-05
6,460 In-Database Machine Learning with CorgiPile: Stochastic Gradient Descent without Full Data Shuffle 2022 SIGMOD 5.7746493e-05
7,816 Nautilus: An Optimized System for Deep Transfer Learning over Evolving Training Datasets 2022 SIGMOD 5.446446e-05
9,153 Cerebro: A Layered Data Platform for Scalable Deep Learning 2021 CIDR 5.217676e-05
9,222 Powering In-Database Dynamic Model Slicing for Structured Data Analytics 2024 VLDB 5.203586e-05
9,907 Scalable Graph Convolutional Network Training on Distributed-Memory Systems 2023 VLDB 5.1092231e-05
10,048 The Image Calculator: 10x Faster Image-AI Inference by Replacing JPEG with Self-designing Storage Format 2024 SIGMOD 5.0896901e-05
11,538 StarfishDB: a Query Execution Engine for Relational Probabilistic Programming 2024 SIGMOD 4.9769913e-05
11,555 Database Native Model Selection: Harnessing Deep Neural Networks in Database Systems 2024 VLDB 4.9769913e-05
13,694 Reimagining Deep Learning Systems Through the Lens of Data Systems 2024 VLDB -
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 32 of 32 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
105 The MADlib Analytics Library or MAD Skills, the SQL 2012 VLDB 0.00033633007
416 SystemML: Declarative Machine Learning on Spark 2016 VLDB 0.00018650998
503 Towards a Unified Architecture for in-RDBMS Analytics 2012 SIGMOD 0.00017195428
950 Lakehouse: A New Generation of Open Platforms that Unify Data Warehousing and Advanced Analytics 2021 CIDR 0.00012889569
976 Democratizing Data Science through Interactive Curation of ML Pipelines 2019 SIGMOD 0.0001274453
1,082 Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML 2014 VLDB 0.00012118261
1,152 Cerebro: A Data System for Optimized Deep Learning Model Selection 2020 VLDB 0.00011796404
1,568 HELIX: Holistic Optimization for Accelerating Iterative Machine Learning 2019 VLDB 0.00010208225
1,614 Compressed Linear Algebra for Large-Scale Machine Learning 2016 VLDB 0.00010067153
2,184 Extending Relational Query Processing with ML Inference 2020 CIDR 8.8953085e-05
2,266 An Intermediate Representation for Optimizing Machine Learning Pipelines 2019 VLDB 8.7248802e-05
2,388 Vertica-ML: Distributed Machine Learning in Vertica Database 2020 SIGMOD 8.5342225e-05
2,401 Declarative Recursive Computation on an RDBMS or, Why You Should Use a Database For Distributed Machine Learning 2019 VLDB 8.517457e-05
2,726 FlexPS: Flexible Parallelism Control in Parameter Server Architecture 2018 VLDB 8.0870349e-05
2,778 AIDA - Abstraction for Advanced In-Database Analytics 2018 VLDB 8.0261532e-05
2,829 DB4ML – An In-Memory Database Kernel with Machine Learning Support 2020 SIGMOD 7.9592539e-05
2,978 In-Database Learning with Sparse Tensors 2018 PODS 7.7872011e-05
3,103 On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML 2018 VLDB 7.6456038e-05
3,632 VISTA: Optimized System for Declarative Feature Transfer from Deep CNNs at Scale 2020 SIGMOD 7.146238e-05
3,685 Cloudy with High Chance of DBMS: A 10-year Prediction for Enterprise-Grade ML 2020 CIDR 7.0972826e-05
3,766 CROSSBOW: Scaling Deep Learning with Small Batch Sizes on Multi-GPU Servers 2019 VLDB 7.0360981e-05
4,182 Rafiki: Machine Learning as an Analytics Service System 2019 VLDB 6.7519862e-05
5,002 GLADE: Big Data Analytics Made Easy 2012 SIGMOD 6.3183539e-05
5,292 Tensor Relational Algebra for Distributed Machine Learning System Design 2021 VLDB 6.1911633e-05
5,437 PS2: Parameter Server on Spark 2019 SIGMOD 6.1279659e-05
5,794 Optimizing Machine Learning Workloads in Collaborative Environments 2020 SIGMOD 5.9906542e-05
6,594 Tuple-oriented Compression for Large-scale Mini-batch Stochastic Gradient Descent 2019 SIGMOD 5.7394502e-05
6,644 Dynamic Parameter Allocation in Parameter Servers 2020 VLDB 5.7224864e-05
7,751 Ease.ml/ci and Ease.ml/meter in Action: Towards Data Management for Statistical Generalization 2019 VLDB 5.4580922e-05
8,609 UDA-GIST: An In-database Framework to Unify Data-Parallel and State-Parallel Analytics 2015 VLDB 5.3025486e-05
9,153 Cerebro: A Layered Data Platform for Scalable Deep Learning 2021 CIDR 5.217676e-05
9,993 DISIMA: A Distributed and Interoperable Image Database System 2000 SIGMOD 5.0985347e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 8,210 Grep: A Graph Learning Based Database Partitioning System 2023 SIGMOD
2 4,675 Data Platform for Machine Learning 2019 SIGMOD
3 2,401 Declarative Recursive Computation on an RDBMS or, Why You Should Use a Database For Distributed Machine Learning 2019 VLDB
4 318 DeepDB: Learn from Data, not from Queries! 2020 VLDB
5 9,564 Towards an Optimized GROUP BY Abstraction for Large-Scale Machine Learning 2021 VLDB
6 2,476 Learning a Partitioning Advisor for Cloud Databases 2020 SIGMOD
7 9,153 Cerebro: A Layered Data Platform for Scalable Deep Learning 2021 CIDR
8 1,152 Cerebro: A Data System for Optimized Deep Learning Model Selection 2020 VLDB
9 7,317 Model-Free Control for Distributed Stream Data Processing using Deep Reinforcement Learning 2018 VLDB
10 13,694 Reimagining Deep Learning Systems Through the Lens of Data Systems 2024 VLDB