DBScholar

Back to papers

Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches

Summary: Compares four ways to integrate Model Hopper Parallelism for deep learning over DB-resident data, prototyped in Greenplum. Finds a Pareto frontier: 3–6× runtime gains can trade off governance, portability, and operational simplicity. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
h7b85e55aba3296c0
Venue
VLDB
Year
2021
Pagerank
6.784003e-05
Overall Rank
4,117 | 72.41%
DOI
10.14778/3467861.3467867
PDF
Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{zhang_vldb21,
        title = {{Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches}},
        author = {Zhang, Yuhao and McQuillan, Frank and Jayaram, Nandish and Kak, Nikhil and Khanna, Ekta and Kislal, Orhan and Valdano, Domino and Kumar, Arun},
        journal = {PVLDB},
        series = {{VLDB} '21},
        volume = {14},
        number = {10},
        pages = {1769--1782},
        doi = {10.14778/3467861.3467867},
        url = {https://doi.org/10.14778/3467861.3467867},
        year = {2021}
}

Incoming Citations (Sorted by Pagerank)

Showing 14 of 14 citing papers.

Rank Citing Paper Year Venue Pagerank
2,672 End-to-end Optimization of Machine Learning Prediction Queries 2022 SIGMOD 8.1301225e-05
3,654 User-Defined Operators: Efficiently Integrating Custom Algorithms into Modern Databases 2022 VLDB 7.1147757e-05
5,291 InferDB: In-Database Machine Learning Inference Using Indexes 2024 VLDB 6.178665e-05
5,795 The Tensor Data Platform: Towards an AI-centric Database System 2023 CIDR 5.9755414e-05
5,916 Lotan: Bridging the Gap between GNNs and Scalable Graph Analytics Engines 2023 VLDB 5.9320442e-05
6,474 In-Database Machine Learning with CorgiPile: Stochastic Gradient Descent without Full Data Shuffle 2022 SIGMOD 5.7555547e-05
7,833 Nautilus: An Optimized System for Deep Transfer Learning over Evolving Training Datasets 2022 SIGMOD 5.4285082e-05
9,175 Cerebro: A Layered Data Platform for Scalable Deep Learning 2021 CIDR 5.2004231e-05
9,245 Powering In-Database Dynamic Model Slicing for Structured Data Analytics 2024 VLDB 5.1863797e-05
9,942 Scalable Graph Convolutional Network Training on Distributed-Memory Systems 2023 VLDB 5.0923288e-05
10,017 The Image Calculator: 10x Faster Image-AI Inference by Replacing JPEG with Self-designing Storage Format 2024 SIGMOD 5.0825892e-05
11,587 StarfishDB: a Query Execution Engine for Relational Probabilistic Programming 2024 SIGMOD 4.9605343e-05
11,604 Database Native Model Selection: Harnessing Deep Neural Networks in Database Systems 2024 VLDB 4.9605343e-05
13,734 Reimagining Deep Learning Systems Through the Lens of Data Systems 2024 VLDB -
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 32 of 32 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
105 The MADlib Analytics Library or MAD Skills, the SQL 2012 VLDB 0.00033605348
415 SystemML: Declarative Machine Learning on Spark 2016 VLDB 0.00018619173
506 Towards a Unified Architecture for in-RDBMS Analytics 2012 SIGMOD 0.00017158546
948 Democratizing Data Science through Interactive Curation of ML Pipelines 2019 SIGMOD 0.00012900728
955 Lakehouse: A New Generation of Open Platforms that Unify Data Warehousing and Advanced Analytics 2021 CIDR 0.00012856295
1,083 Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML 2014 VLDB 0.00012089325
1,154 Cerebro: A Data System for Optimized Deep Learning Model Selection 2020 VLDB 0.00011762688
1,567 HELIX: Holistic Optimization for Accelerating Iterative Machine Learning 2019 VLDB 0.00010179013
1,615 Compressed Linear Algebra for Large-Scale Machine Learning 2016 VLDB 0.00010054378
2,199 Extending Relational Query Processing with ML Inference 2020 CIDR 8.8664379e-05
2,278 An Intermediate Representation for Optimizing Machine Learning Pipelines 2019 VLDB 8.6993865e-05
2,398 Vertica-ML: Distributed Machine Learning in Vertica Database 2020 SIGMOD 8.5070634e-05
2,407 Declarative Recursive Computation on an RDBMS or, Why You Should Use a Database For Distributed Machine Learning 2019 VLDB 8.4928721e-05
2,737 FlexPS: Flexible Parallelism Control in Parameter Server Architecture 2018 VLDB 8.060868e-05
2,783 AIDA - Abstraction for Advanced In-Database Analytics 2018 VLDB 8.0027405e-05
2,834 DB4ML – An In-Memory Database Kernel with Machine Learning Support 2020 SIGMOD 7.9442734e-05
2,974 In-Database Learning with Sparse Tensors 2018 PODS 7.7812156e-05
3,104 On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML 2018 VLDB 7.6281929e-05
3,643 VISTA: Optimized System for Declarative Feature Transfer from Deep CNNs at Scale 2020 SIGMOD 7.1227166e-05
3,691 Cloudy with High Chance of DBMS: A 10-year Prediction for Enterprise-Grade ML 2020 CIDR 7.0771037e-05
3,770 CROSSBOW: Scaling Deep Learning with Small Batch Sizes on Multi-GPU Servers 2019 VLDB 7.0145345e-05
4,198 Rafiki: Machine Learning as an Analytics Service System 2019 VLDB 6.7303243e-05
4,762 Tensor Relational Algebra for Distributed Machine Learning System Design 2021 VLDB 6.4190861e-05
4,993 GLADE: Big Data Analytics Made Easy 2012 SIGMOD 6.3109925e-05
5,454 PS2: Parameter Server on Spark 2019 SIGMOD 6.1077156e-05
5,808 Optimizing Machine Learning Workloads in Collaborative Environments 2020 SIGMOD 5.9708628e-05
6,603 Tuple-oriented Compression for Large-scale Mini-batch Stochastic Gradient Descent 2019 SIGMOD 5.7204739e-05
6,655 Dynamic Parameter Allocation in Parameter Servers 2020 VLDB 5.7036819e-05
7,765 Ease.ml/ci and Ease.ml/meter in Action: Towards Data Management for Statistical Generalization 2019 VLDB 5.4400458e-05
8,627 UDA-GIST: An In-database Framework to Unify Data-Parallel and State-Parallel Analytics 2015 VLDB 5.2850166e-05
9,175 Cerebro: A Layered Data Platform for Scalable Deep Learning 2021 CIDR 5.2004231e-05
10,028 DISIMA: A Distributed and Interoperable Image Database System 2000 SIGMOD 5.0816772e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 8,225 Grep: A Graph Learning Based Database Partitioning System 2023 SIGMOD
2 4,687 Data Platform for Machine Learning 2019 SIGMOD
3 2,407 Declarative Recursive Computation on an RDBMS or, Why You Should Use a Database For Distributed Machine Learning 2019 VLDB
4 320 DeepDB: Learn from Data, not from Queries! 2020 VLDB
5 9,589 Towards an Optimized GROUP BY Abstraction for Large-Scale Machine Learning 2021 VLDB
6 2,481 Learning a Partitioning Advisor for Cloud Databases 2020 SIGMOD
7 9,175 Cerebro: A Layered Data Platform for Scalable Deep Learning 2021 CIDR
8 1,154 Cerebro: A Data System for Optimized Deep Learning Model Selection 2020 VLDB
9 7,333 Model-Free Control for Distributed Stream Data Processing using Deep Reinforcement Learning 2018 VLDB
10 13,734 Reimagining Deep Learning Systems Through the Lens of Data Systems 2024 VLDB