DBScholar

Back to papers

Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML

Summary: SystemML combines task and data parallelism for declarative, large-scale ML via a generic ParFOR construct over MapReduce. A cost-based optimizer automatically selects multi-core and cluster execution plans, adapting to workloads and unknown data characteristics. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
ha5d406fbdd20049f
Venue
VLDB
Year
2014
Pagerank
0.00012089325
Overall Rank
1,083 | 92.75%
DOI
10.14778/2732296.2732302
PDF
Download (CC BY-NC-ND 3.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{boehm_vldb14,
        title = {{Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML}},
        author = {Boehm, Matthias and Tatikonda, Shirish and Reinwald, Berthold and Sen, Prithviraj and Tian, Yuanyuan and Burdick, Douglas R. and Vaithyanathan, Shivakumar},
        journal = {PVLDB},
        series = {{VLDB} '14},
        volume = {7},
        number = {7},
        pages = {553--564},
        doi = {10.14778/2732296.2732302},
        url = {https://doi.org/10.14778/2732296.2732302},
        year = {2014}
}

Incoming Citations (Sorted by Pagerank)

Showing 36 of 36 citing papers.

Rank Citing Paper Year Venue Pagerank
415 SystemML: Declarative Machine Learning on Spark 2016 VLDB 0.00018619173
522 Learning Linear Regression Models over Factorized Joins 2016 SIGMOD 0.00016893112
1,154 Cerebro: A Data System for Optimized Deep Learning Model Selection 2020 VLDB 0.00011762688
1,200 Towards Linear Algebra over Normalized Data 2017 VLDB 0.00011524945
1,226 Data Management in Machine Learning: Challenges, Techniques, and Systems 2017 SIGMOD 0.00011432354
1,616 SystemDS: A Declarative Machine Learning System for the End-to-End Data Science Lifecycle 2020 CIDR 0.00010048776
2,278 An Intermediate Representation for Optimizing Machine Learning Pipelines 2019 VLDB 8.6993865e-05
2,341 SliceLine: Fast, Linear-Algebra-based Slice Finding for ML Model Debugging 2021 SIGMOD 8.5984124e-05
2,720 Exploiting Matrix Dependency for Efficient Distributed Matrix Computation 2015 SIGMOD 8.0778267e-05
2,974 In-Database Learning with Sparse Tensors 2018 PODS 7.7812156e-05
3,104 On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML 2018 VLDB 7.6281929e-05
3,256 Towards Demystifying Serverless Machine Learning Training 2021 SIGMOD 7.4732677e-05
3,528 A Comparative Evaluation of Systems for Scalable Linear Algebra-based Analytics 2018 VLDB 7.2134232e-05
4,117 Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches 2021 VLDB 6.784003e-05
4,134 Resource Elasticity for Large-Scale Machine Learning 2015 SIGMOD 6.7721426e-05
4,354 LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems 2021 SIGMOD 6.6318545e-05
5,230 Saga: A Scalable Framework for Optimizing Data Cleaning Pipelines for Machine Learning Applications 2023 SIGMOD 6.2059854e-05
5,327 Probabilistic Demand Forecasting at Scale 2017 VLDB 6.1639984e-05
6,011 BAGUA: Scaling up Distributed Learning with System Relaxations 2022 VLDB 5.8975241e-05
6,573 DeepBase: Deep Inspection of Neural Networks 2019 SIGMOD 5.7271875e-05
6,603 Tuple-oriented Compression for Large-scale Mini-batch Stochastic Gradient Descent 2019 SIGMOD 5.7204739e-05
6,679 UPLIFT: Parallelization Strategies for Feature Transformations in Machine Learning Workloads 2022 VLDB 5.6956362e-05
6,902 DAPHNE: An Open and Extensible System Infrastructure for Integrated Data Analysis Pipelines 2022 CIDR 5.6365602e-05
7,168 A Cost-based Optimizer for Gradient Descent Optimization 2017 SIGMOD 5.5794432e-05
8,097 Robust Recursive Query Parallelism in Graph Database Management Systems 2025 VLDB 5.3739121e-05
8,620 Not Black-Box Anymore! Enabling Analytics-Aware Optimizations in Teradata Vantage 2021 VLDB 5.2868261e-05
9,048 The Power of Nested Parallelism in Big Data Processing – Hitting Three Flies with One Slap – 2021 SIGMOD 5.2155403e-05
9,589 Towards an Optimized GROUP BY Abstraction for Large-Scale Machine Learning 2021 VLDB 5.1377385e-05
9,691 BladeDISC: Optimizing Dynamic Shape Machine Learning Workloads via Compiler Approach 2023 SIGMOD 5.1258854e-05
9,785 PlinyCompute: A Platform for High-Performance, Distributed, Data-Intensive Tool Development 2018 SIGMOD 5.115551e-05
10,513 DFLOP: A Data-driven Framework for Multimodal LLM Training Pipeline Optimization 2026 SIGMOD 4.9605343e-05
10,968 stratum: A System Infrastructure for Massive Agent-Centric ML Workloads 2026 VLDB 4.9605343e-05
11,307 Quantum Data Management in the NISQ Era 2025 VLDB 4.9605343e-05
11,604 Database Native Model Selection: Harnessing Deep Neural Networks in Database Systems 2024 VLDB 4.9605343e-05
12,026 Hybrid Evaluation for Distributed Iterative Matrix Computation 2021 SIGMOD 4.9605343e-05
12,402 dmapply: A functional primitive to express distributed machine learning algorithms in R 2016 VLDB 4.9605343e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 16 of 16 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
6 Pig Latin: A Not-So-Foreign Language for Data Processing 2008 SIGMOD 0.0010494385
22 Distributed GraphLab: A Framework for Machine Learning and Data Mining in the Cloud 2012 VLDB 0.00056028465
31 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB 0.00049707539
154 MAD Skills: New Analysis Practices for Big Data 2009 VLDB 0.00028524078
538 MLbase: A Distributed Machine-learning System 2013 CIDR 0.00016725463
759 Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs 2011 VLDB 0.00014194746
825 MRShare: Sharing Across Multiple Queries in MapReduce 2010 VLDB 0.00013600553
944 Starfish: A Self-tuning System for Big Data Analytics 2011 CIDR 0.00012927479
1,040 Jaql: A Scripting Language for Large Scale Semistructured Data Analysis 2011 VLDB 0.00012336829
1,050 RIOT: I/O-Efficient Numerical Computing without SQL 2009 CIDR 0.00012291671
1,375 Ricardo: Integrating R and Hadoop 2010 SIGMOD 0.00010861932
2,124 Opening the Black Boxes in Data Flow Optimization 2012 VLDB 8.9915327e-05
2,250 Cumulon: Optimizing Statistical Data Analysis in the Cloud 2013 SIGMOD 8.7477605e-05
2,532 Stubby: A Transformation-based Optimizer for MapReduce Workflows 2012 VLDB 8.3132509e-05
3,799 Large-Scale Machine Learning at Twitter 2012 SIGMOD 6.9933489e-05
4,231 Optimizing I/O for Big Array Analytics 2012 VLDB 6.7050212e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 9,629 Model-Parallel Model Selection for Deep Learning Systems 2021 SIGMOD
2 2,758 Implicit Parallelism through Deep Language Embedding 2015 SIGMOD
3 43 A Comparison of Approaches to Large-Scale Data Analysis 2009 SIGMOD
4 538 MLbase: A Distributed Machine-learning System 2013 CIDR
5 5,505 Automatic Optimization of Matrix Implementations for Distributed Machine Learning and Linear Algebra 2021 SIGMOD
6 12,026 Hybrid Evaluation for Distributed Iterative Matrix Computation 2021 SIGMOD
7 9,589 Towards an Optimized GROUP BY Abstraction for Large-Scale Machine Learning 2021 VLDB
8 4,134 Resource Elasticity for Large-Scale Machine Learning 2015 SIGMOD
9 3,104 On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML 2018 VLDB
10 415 SystemML: Declarative Machine Learning on Spark 2016 VLDB