DBScholar

Back to papers

Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches

Summary: Compares four ways to integrate Model Hopper Parallelism for deep learning over DB-resident data, prototyped in Greenplum. Finds a Pareto frontier: 3–6× runtime gains can trade off governance, portability, and operational simplicity. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
h7b85e55aba3296c0
Venue
VLDB
Year
2021
Pagerank
6.8095767e-05
Overall Rank
4,095 | 72.47%
DOI
10.14778/3467861.3467867

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{zhang_vldb21,
        title = {{Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches}},
        author = {Zhang, Yuhao and McQuillan, Frank and Jayaram, Nandish and Kak, Nikhil and Khanna, Ekta and Kislal, Orhan and Valdano, Domino and Kumar, Arun},
        journal = {PVLDB},
        series = {{VLDB} '21},
        volume = {14},
        number = {10},
        pages = {1769--1782},
        doi = {10.14778/3467861.3467867},
        url = {https://doi.org/10.14778/3467861.3467867},
        year = {2021}
}

Incoming Citations (Sorted by Pagerank)

Showing 14 of 14 citing papers.

Rank Citing Paper Year Venue Pagerank
2,662 End-to-end Optimization of Machine Learning Prediction Queries 2022 SIGMOD 8.1596229e-05
3,642 User-Defined Operators: Efficiently Integrating Custom Algorithms into Modern Databases 2022 VLDB 7.1416697e-05
5,272 InferDB: In-Database Machine Learning Inference Using Indexes 2024 VLDB 6.2010954e-05
5,776 The Tensor Data Platform: Towards an AI-centric Database System 2023 CIDR 5.9981216e-05
5,899 Lotan: Bridging the Gap between GNNs and Scalable Graph Analytics Engines 2023 VLDB 5.9545431e-05
6,458 In-Database Machine Learning with CorgiPile: Stochastic Gradient Descent without Full Data Shuffle 2022 SIGMOD 5.7773842e-05
7,809 Nautilus: An Optimized System for Deep Transfer Learning over Evolving Training Datasets 2022 SIGMOD 5.4490255e-05
9,144 Cerebro: A Layered Data Platform for Scalable Deep Learning 2021 CIDR 5.2201471e-05
9,212 Powering In-Database Dynamic Model Slicing for Structured Data Analytics 2024 VLDB 5.2060505e-05
9,900 Scalable Graph Convolutional Network Training on Distributed-Memory Systems 2023 VLDB 5.1116429e-05
10,043 The Image Calculator: 10x Faster Image-AI Inference by Replacing JPEG with Self-designing Storage Format 2024 SIGMOD 5.0921006e-05
11,532 StarfishDB: a Query Execution Engine for Relational Probabilistic Programming 2024 SIGMOD 4.9793485e-05
11,549 Database Native Model Selection: Harnessing Deep Neural Networks in Database Systems 2024 VLDB 4.9793485e-05
13,689 Reimagining Deep Learning Systems Through the Lens of Data Systems 2024 VLDB -
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 32 of 32 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
105 The MADlib Analytics Library or MAD Skills, the SQL 2012 VLDB 0.00033638251
415 SystemML: Declarative Machine Learning on Spark 2016 VLDB 0.0001865959
503 Towards a Unified Architecture for in-RDBMS Analytics 2012 SIGMOD 0.00017202276
950 Lakehouse: A New Generation of Open Platforms that Unify Data Warehousing and Advanced Analytics 2021 CIDR 0.00012895553
975 Democratizing Data Science through Interactive Curation of ML Pipelines 2019 SIGMOD 0.00012750518
1,081 Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML 2014 VLDB 0.00012123917
1,152 Cerebro: A Data System for Optimized Deep Learning Model Selection 2020 VLDB 0.00011801961
1,568 HELIX: Holistic Optimization for Accelerating Iterative Machine Learning 2019 VLDB 0.0001021302
1,614 Compressed Linear Algebra for Large-Scale Machine Learning 2016 VLDB 0.00010071891
2,182 Extending Relational Query Processing with ML Inference 2020 CIDR 8.8982998e-05
2,264 An Intermediate Representation for Optimizing Machine Learning Pipelines 2019 VLDB 8.7289107e-05
2,386 Vertica-ML: Distributed Machine Learning in Vertica Database 2020 SIGMOD 8.538263e-05
2,400 Declarative Recursive Computation on an RDBMS or, Why You Should Use a Database For Distributed Machine Learning 2019 VLDB 8.5213814e-05
2,725 FlexPS: Flexible Parallelism Control in Parameter Server Architecture 2018 VLDB 8.090861e-05
2,778 AIDA - Abstraction for Advanced In-Database Analytics 2018 VLDB 8.0299506e-05
2,830 DB4ML – An In-Memory Database Kernel with Machine Learning Support 2020 SIGMOD 7.9619979e-05
2,975 In-Database Learning with Sparse Tensors 2018 PODS 7.7907759e-05
3,101 On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML 2018 VLDB 7.649219e-05
3,630 VISTA: Optimized System for Declarative Feature Transfer from Deep CNNs at Scale 2020 SIGMOD 7.1496182e-05
3,683 Cloudy with High Chance of DBMS: A 10-year Prediction for Enterprise-Grade ML 2020 CIDR 7.1006425e-05
3,764 CROSSBOW: Scaling Deep Learning with Small Batch Sizes on Multi-GPU Servers 2019 VLDB 7.0394265e-05
4,182 Rafiki: Machine Learning as an Analytics Service System 2019 VLDB 6.755131e-05
5,001 GLADE: Big Data Analytics Made Easy 2012 SIGMOD 6.3197648e-05
5,289 Tensor Relational Algebra for Distributed Machine Learning System Design 2021 VLDB 6.1940481e-05
5,433 PS2: Parameter Server on Spark 2019 SIGMOD 6.1308667e-05
5,792 Optimizing Machine Learning Workloads in Collaborative Environments 2020 SIGMOD 5.99349e-05
6,592 Tuple-oriented Compression for Large-scale Mini-batch Stochastic Gradient Descent 2019 SIGMOD 5.7421684e-05
6,640 Dynamic Parameter Allocation in Parameter Servers 2020 VLDB 5.7251952e-05
7,745 Ease.ml/ci and Ease.ml/meter in Action: Towards Data Management for Statistical Generalization 2019 VLDB 5.4606673e-05
8,602 UDA-GIST: An In-database Framework to Unify Data-Parallel and State-Parallel Analytics 2015 VLDB 5.3050579e-05
9,144 Cerebro: A Layered Data Platform for Scalable Deep Learning 2021 CIDR 5.2201471e-05
9,984 DISIMA: A Distributed and Interoperable Image Database System 2000 SIGMOD 5.100948e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 8,202 Grep: A Graph Learning Based Database Partitioning System 2023 SIGMOD
2 4,672 Data Platform for Machine Learning 2019 SIGMOD
3 2,400 Declarative Recursive Computation on an RDBMS or, Why You Should Use a Database For Distributed Machine Learning 2019 VLDB
4 318 DeepDB: Learn from Data, not from Queries! 2020 VLDB
5 9,556 Towards an Optimized GROUP BY Abstraction for Large-Scale Machine Learning 2021 VLDB
6 2,478 Learning a Partitioning Advisor for Cloud Databases 2020 SIGMOD
7 9,144 Cerebro: A Layered Data Platform for Scalable Deep Learning 2021 CIDR
8 1,152 Cerebro: A Data System for Optimized Deep Learning Model Selection 2020 VLDB
9 7,315 Model-Free Control for Distributed Stream Data Processing using Deep Reinforcement Learning 2018 VLDB
10 13,689 Reimagining Deep Learning Systems Through the Lens of Data Systems 2024 VLDB