DBScholar

Back to papers

Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML

Summary: SystemML combines task and data parallelism for declarative, large-scale ML via a generic ParFOR construct over MapReduce. A cost-based optimizer automatically selects multi-core and cluster execution plans, adapting to workloads and unknown data characteristics. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
11121
Venue
VLDB
Year
2014
Pagerank
0.00012258469
Overall Rank
1,079 | 92.60%
DOI
10.14778/2732296.2732302

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{boehm_vldb14,
        title = {{Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML}},
        author = {Boehm, Matthias and Tatikonda, Shirish and Reinwald, Berthold and Sen, Prithviraj and Tian, Yuanyuan and Burdick, Douglas R. and Vaithyanathan, Shivakumar},
        journal = {PVLDB},
        series = {{VLDB} '14},
        volume = {7},
        number = {7},
        pages = {553--564},
        doi = {10.14778/2732296.2732302},
        url = {https://doi.org/10.14778/2732296.2732302},
        year = {2014}
}

Incoming Citations (Sorted by Pagerank)

Showing 35 of 35 citing papers.

Rank Citing Paper Year Venue Pagerank
415 SystemML: Declarative Machine Learning on Spark 2016 VLDB 0.0001888524
536 Learning Linear Regression Models over Factorized Joins 2016 SIGMOD 0.0001693369
1,157 Cerebro: A Data System for Optimized Deep Learning Model Selection 2020 VLDB 0.00011924049
1,235 Towards Linear Algebra over Normalized Data 2017 VLDB 0.00011548457
1,250 Data Management in Machine Learning: Challenges, Techniques, and Systems 2017 SIGMOD 0.00011485301
1,756 SystemDS: A Declarative Machine Learning System for the End-to-End Data Science Lifecycle 2020 CIDR 9.8172465e-05
2,239 An Intermediate Representation for Optimizing Machine Learning Pipelines 2019 VLDB 8.8875753e-05
2,273 SliceLine: Fast, Linear-Algebra-based Slice Finding for ML Model Debugging 2021 SIGMOD 8.8230899e-05
2,681 Exploiting Matrix Dependency for Efficient Distributed Matrix Computation 2015 SIGMOD 8.2632778e-05
2,927 In-Database Learning with Sparse Tensors 2018 PODS 7.9531195e-05
3,169 Towards Demystifying Serverless Machine Learning Training 2021 SIGMOD 7.6715222e-05
3,205 On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML 2018 VLDB 7.6386536e-05
3,459 A Comparative Evaluation of Systems for Scalable Linear Algebra-based Analytics 2018 VLDB 7.3953716e-05
4,049 Resource Elasticity for Large-Scale Machine Learning 2015 SIGMOD 6.9369379e-05
4,067 Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches 2021 VLDB 6.9293511e-05
4,240 LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems 2021 SIGMOD 6.809685e-05
5,182 Probabilistic Demand Forecasting at Scale 2017 VLDB 6.3287692e-05
5,876 BAGUA: Scaling up Distributed Learning with System Relaxations 2022 VLDB 6.0557672e-05
6,427 DeepBase: Deep Inspection of Neural Networks 2019 SIGMOD 5.8808145e-05
6,485 Tuple-oriented Compression for Large-scale Mini-batch Stochastic Gradient Descent 2019 SIGMOD 5.8657457e-05
6,538 UPLIFT: Parallelization Strategies for Feature Transformations in Machine Learning Workloads 2022 VLDB 5.8477764e-05
7,000 A Cost-based Optimizer for Gradient Descent Optimization 2017 SIGMOD 5.7287645e-05
7,160 DAPHNE: An Open and Extensible System Infrastructure for Integrated Data Analysis Pipelines 2022 CIDR 5.6855887e-05
7,232 Saga: A Scalable Framework for Optimizing Data Cleaning Pipelines for Machine Learning Applications 2023 SIGMOD 5.6659017e-05
8,450 Not Black-Box Anymore! Enabling Analytics-Aware Optimizations in Teradata Vantage 2021 VLDB 5.4231788e-05
8,958 The Power of Nested Parallelism in Big Data Processing – Hitting Three Flies with One Slap – 2021 SIGMOD 5.3449654e-05
9,371 Towards an Optimized GROUP BY Abstraction for Large-Scale Machine Learning 2021 VLDB 5.275595e-05
9,475 BladeDISC: Optimizing Dynamic Shape Machine Learning Workloads via Compiler Approach 2023 SIGMOD 5.2634238e-05
9,572 PlinyCompute: A Platform for High-Performance, Distributed, Data-Intensive Tool Development 2018 SIGMOD 5.2528121e-05
10,219 DFLOP: A Data-driven Framework for Multimodal LLM Training Pipeline Optimization 2026 SIGMOD 5.093636e-05
10,836 Quantum Data Management in the NISQ Era 2025 VLDB 5.093636e-05
10,982 Robust Recursive Query Parallelism in Graph Database Management Systems 2025 VLDB 5.093636e-05
11,209 Database Native Model Selection: Harnessing Deep Neural Networks in Database Systems 2024 VLDB 5.093636e-05
11,669 Hybrid Evaluation for Distributed Iterative Matrix Computation 2021 SIGMOD 5.093636e-05
12,060 dmapply: A functional primitive to express distributed machine learning algorithms in R 2016 VLDB 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 16 of 16 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
6 Pig Latin: A Not-So-Foreign Language for Data Processing 2008 SIGMOD 0.0010686205
20 Distributed GraphLab: A Framework for Machine Learning and Data Mining in the Cloud 2012 VLDB 0.00056944564
32 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB 0.00050111008
155 MAD Skills: New Analysis Practices for Big Data 2009 VLDB 0.00028713176
532 MLbase: A Distributed Machine-learning System 2013 CIDR 0.00017072641
735 Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs 2011 VLDB 0.00014522606
803 MRShare: Sharing Across Multiple Queries in MapReduce 2010 VLDB 0.00013899943
923 Starfish: A Self-tuning System for Big Data Analytics 2011 CIDR 0.00013189886
1,021 Jaql: A Scripting Language for Large Scale Semistructured Data Analysis 2011 VLDB 0.00012606673
1,039 RIOT: I/O-Efficient Numerical Computing without SQL 2009 CIDR 0.00012474977
1,333 Ricardo: Integrating R and Hadoop 2010 SIGMOD 0.0001112858
2,164 Opening the Black Boxes in Data Flow Optimization 2012 VLDB 9.0521951e-05
2,217 Cumulon: Optimizing Statistical Data Analysis in the Cloud 2013 SIGMOD 8.9332438e-05
2,486 Stubby: A Transformation-based Optimizer for MapReduce Workflows 2012 VLDB 8.5143189e-05
3,714 Large-Scale Machine Learning at Twitter 2012 SIGMOD 7.1764857e-05
4,137 Optimizing I/O for Big Array Analytics 2012 VLDB 6.8783832e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 9,414 Model-Parallel Model Selection for Deep Learning Systems 2021 SIGMOD
2 2,717 Implicit Parallelism through Deep Language Embedding 2015 SIGMOD
3 44 A Comparison of Approaches to Large-Scale Data Analysis 2009 SIGMOD
4 532 MLbase: A Distributed Machine-learning System 2013 CIDR
5 6,046 Automatic Optimization of Matrix Implementations for Distributed Machine Learning and Linear Algebra 2021 SIGMOD
6 11,669 Hybrid Evaluation for Distributed Iterative Matrix Computation 2021 SIGMOD
7 9,371 Towards an Optimized GROUP BY Abstraction for Large-Scale Machine Learning 2021 VLDB
8 4,049 Resource Elasticity for Large-Scale Machine Learning 2015 SIGMOD
9 3,205 On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML 2018 VLDB
10 415 SystemML: Declarative Machine Learning on Spark 2016 VLDB