DBScholar

Back to papers

Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches

Summary: Compares four ways to integrate Model Hopper Parallelism for deep learning over DB-resident data, prototyped in Greenplum. Finds a Pareto frontier: 3–6× runtime gains can trade off governance, portability, and operational simplicity. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
12550
Venue
VLDB
Year
2021
Pagerank
6.9293511e-05
Overall Rank
4,067 | 72.10%
DOI
10.14778/3467861.3467867

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{zhang_vldb21,
        title = {{Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches}},
        author = {Zhang, Yuhao and McQuillan, Frank and Jayaram, Nandish and Kak, Nikhil and Khanna, Ekta and Kislal, Orhan and Valdano, Domino and Kumar, Arun},
        journal = {PVLDB},
        series = {{VLDB} '21},
        volume = {14},
        number = {10},
        pages = {1769--1782},
        doi = {10.14778/3467861.3467867},
        url = {https://doi.org/10.14778/3467861.3467867},
        year = {2021}
}

Incoming Citations (Sorted by Pagerank)

Showing 14 of 14 citing papers.

Rank Citing Paper Year Venue Pagerank
2,865 End-to-end Optimization of Machine Learning Prediction Queries 2022 SIGMOD 8.0180243e-05
4,273 User-Defined Operators: Efficiently Integrating Custom Algorithms into Modern Databases 2022 VLDB 6.7909197e-05
5,456 InferDB: In-Database Machine Learning Inference Using Indexes 2024 VLDB 6.2131252e-05
5,953 The Tensor Data Platform: Towards an AI-centric Database System 2023 CIDR 6.0309873e-05
6,339 In-Database Machine Learning with CorgiPile: Stochastic Gradient Descent without Full Data Shuffle 2022 SIGMOD 5.907165e-05
6,588 Lotan: Bridging the Gap between GNNs and Scalable Graph Analytics Engines 2023 VLDB 5.833338e-05
7,656 Nautilus: An Optimized System for Deep Transfer Learning over Evolving Training Datasets 2022 SIGMOD 5.5740571e-05
8,979 Cerebro: A Layered Data Platform for Scalable Deep Learning 2021 CIDR 5.3399615e-05
9,470 Powering In-Database Dynamic Model Slicing for Structured Data Analytics 2024 VLDB 5.2634238e-05
9,729 Scalable Graph Convolutional Network Training on Distributed-Memory Systems 2023 VLDB 5.2289669e-05
9,881 The Image Calculator: 10x Faster Image-AI Inference by Replacing JPEG with Self-designing Storage Format 2024 SIGMOD 5.2040783e-05
11,189 StarfishDB: a Query Execution Engine for Relational Probabilistic Programming 2024 SIGMOD 5.093636e-05
11,209 Database Native Model Selection: Harnessing Deep Neural Networks in Database Systems 2024 VLDB 5.093636e-05
13,375 Reimagining Deep Learning Systems Through the Lens of Data Systems 2024 VLDB -
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 32 of 32 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
106 The MADlib Analytics Library or MAD Skills, the SQL 2012 VLDB 0.00033539462
415 SystemML: Declarative Machine Learning on Spark 2016 VLDB 0.0001888524
518 Towards a Unified Architecture for in-RDBMS Analytics 2012 SIGMOD 0.00017167492
1,004 Democratizing Data Science through Interactive Curation of ML Pipelines 2019 SIGMOD 0.00012701932
1,079 Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML 2014 VLDB 0.00012258469
1,138 Lakehouse: A New Generation of Open Platforms that Unify Data Warehousing and Advanced Analytics 2021 CIDR 0.00012023643
1,157 Cerebro: A Data System for Optimized Deep Learning Model Selection 2020 VLDB 0.00011924049
1,569 HELIX: Holistic Optimization for Accelerating Iterative Machine Learning 2019 VLDB 0.00010335423
1,644 Compressed Linear Algebra for Large-Scale Machine Learning 2016 VLDB 0.00010132912
2,239 An Intermediate Representation for Optimizing Machine Learning Pipelines 2019 VLDB 8.8875753e-05
2,293 Extending Relational Query Processing with ML Inference 2020 CIDR 8.7949378e-05
2,347 Vertica-ML: Distributed Machine Learning in Vertica Database 2020 SIGMOD 8.7157552e-05
2,370 Declarative Recursive Computation on an RDBMS or, Why You Should Use a Database For Distributed Machine Learning 2019 VLDB 8.6795925e-05
2,693 FlexPS: Flexible Parallelism Control in Parameter Server Architecture 2018 VLDB 8.247004e-05
2,786 DB4ML – An In-Memory Database Kernel with Machine Learning Support 2020 SIGMOD 8.1207221e-05
2,847 AIDA - Abstraction for Advanced In-Database Analytics 2018 VLDB 8.0583142e-05
2,927 In-Database Learning with Sparse Tensors 2018 PODS 7.9531195e-05
3,205 On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML 2018 VLDB 7.6386536e-05
3,573 VISTA: Optimized System for Declarative Feature Transfer from Deep CNNs at Scale 2020 SIGMOD 7.2977194e-05
3,614 Cloudy with High Chance of DBMS: A 10-year Prediction for Enterprise-Grade ML 2020 CIDR 7.2568185e-05
3,782 CROSSBOW: Scaling Deep Learning with Small Batch Sizes on Multi-GPU Servers 2019 VLDB 7.1298979e-05
4,118 Rafiki: Machine Learning as an Analytics Service System 2019 VLDB 6.8908973e-05
4,897 GLADE: Big Data Analytics Made Easy 2012 SIGMOD 6.4546134e-05
5,195 Tensor Relational Algebra for Distributed Machine Learning System Design 2021 VLDB 6.3232105e-05
5,345 PS2: Parameter Server on Spark 2019 SIGMOD 6.2586047e-05
5,699 Optimizing Machine Learning Workloads in Collaborative Environments 2020 SIGMOD 6.1170243e-05
6,485 Tuple-oriented Compression for Large-scale Mini-batch Stochastic Gradient Descent 2019 SIGMOD 5.8657457e-05
6,519 Dynamic Parameter Allocation in Parameter Servers 2020 VLDB 5.8536062e-05
7,609 Ease.ml/ci and Ease.ml/meter in Action: Towards Data Management for Statistical Generalization 2019 VLDB 5.5841767e-05
8,432 UDA-GIST: An In-database Framework to Unify Data-Parallel and State-Parallel Analytics 2015 VLDB 5.4259582e-05
8,979 Cerebro: A Layered Data Platform for Scalable Deep Learning 2021 CIDR 5.3399615e-05
9,802 DISIMA: A Distributed and Interoperable Image Database System 2000 SIGMOD 5.2173744e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 8,042 Grep: A Graph Learning Based Database Partitioning System 2023 SIGMOD
2 4,592 Data Platform for Machine Learning 2019 SIGMOD
3 2,370 Declarative Recursive Computation on an RDBMS or, Why You Should Use a Database For Distributed Machine Learning 2019 VLDB
4 323 DeepDB: Learn from Data, not from Queries! 2020 VLDB
5 9,371 Towards an Optimized GROUP BY Abstraction for Large-Scale Machine Learning 2021 VLDB
6 2,499 Learning a Partitioning Advisor for Cloud Databases 2020 SIGMOD
7 8,979 Cerebro: A Layered Data Platform for Scalable Deep Learning 2021 CIDR
8 1,157 Cerebro: A Data System for Optimized Deep Learning Model Selection 2020 VLDB
9 7,194 Model-Free Control for Distributed Stream Data Processing using Deep Reinforcement Learning 2018 VLDB
10 13,375 Reimagining Deep Learning Systems Through the Lens of Data Systems 2024 VLDB