Database Paper Browser

Back to papers

Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML

Summary: Hybrid parallelization strategies for large-scale ML on MapReduce in SystemML; combines data and task parallelism. Cost-based optimization automatically yields optimal parallel plans and adapts to ad-hoc workloads and data characteristics using ParFOR. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
10934
Venue
VLDB
Year
2014
Pagerank
0.00012163413
Overall Rank
1,407 | 90.23%
DOI
-

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 33 of 33 citing papers.

Rank Citing Paper Year Venue Pagerank
557 SystemML: Declarative Machine Learning on Spark 2016 VLDB 0.00020186115
684 Cerebro: A Data System for Optimized Deep Learning Model Selection 2020 VLDB 0.00018152321
832 Learning Linear Regression Models over Factorized Joins 2016 SIGMOD 0.00016089705
1,283 Towards Linear Algebra over Normalized Data 2017 VLDB 0.00012826013
1,534 Data Management in Machine Learning: Challenges, Techniques, and Systems 2017 SIGMOD 0.00011462072
1,942 SliceLine: Fast, Linear-Algebra-based Slice Finding for ML Model Debugging 2021 SIGMOD 0.00010010569
2,122 SystemDS: A Declarative Machine Learning System for the End-to-End Data Science Lifecycle 2020 CIDR 9.4905306e-05
2,355 An Intermediate Representation for Optimizing Machine Learning Pipelines 2019 VLDB 8.9727612e-05
2,795 Towards Demystifying Serverless Machine Learning Training 2021 SIGMOD 8.1135606e-05
2,855 Exploiting Matrix Dependency for Efficient Distributed Matrix Computation 2015 SIGMOD 8.013421e-05
3,920 On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML 2018 VLDB 6.6246708e-05
3,953 A Comparative Evaluation of Systems for Scalable Linear Algebra-based Analytics 2018 VLDB 6.5896733e-05
4,601 Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches 2021 VLDB 6.05274e-05
4,779 LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems 2021 SIGMOD 5.9259373e-05
4,807 Resource Elasticity for Large-Scale Machine Learning 2015 SIGMOD 5.9045148e-05
5,265 Probabilistic Demand Forecasting at Scale 2017 VLDB 5.5950627e-05
5,730 BAGUA: Scaling up Distributed Learning with System Relaxations 2022 VLDB 5.3476346e-05
6,371 DeepBase: Deep Inspection of Neural Networks 2019 SIGMOD 5.0880545e-05
6,535 Tuple-oriented Compression for Large-scale Mini-batch Stochastic Gradient Descent 2019 SIGMOD 5.0184189e-05
6,984 A Cost-based Optimizer for Gradient Descent Optimization 2017 SIGMOD 4.8680519e-05
7,303 DAPHNE: An Open and Extensible System Infrastructure for Integrated Data Analysis Pipelines 2022 CIDR 4.7632836e-05
8,096 Saga: A Scalable Framework for Optimizing Data Cleaning Pipelines for Machine Learning Applications 2023 SIGMOD 4.583522e-05
8,435 Not Black-Box Anymore! Enabling Analytics-Aware Optimizations in Teradata Vantage 2021 VLDB 4.5075971e-05
8,515 UPLIFT: Parallelization Strategies for Feature Transformations in Machine Learning Workloads 2022 VLDB 4.4901466e-05
9,008 The Power of Nested Parallelism in Big Data Processing – Hitting Three Flies with One Slap – 2021 SIGMOD 4.4065351e-05
9,225 Towards an Optimized GROUP BY Abstraction for Large-Scale Machine Learning 2021 VLDB 4.3656789e-05
9,331 BladeDISC: Optimizing Dynamic Shape Machine Learning Workloads via Compiler Approach 2023 SIGMOD 4.351469e-05
9,337 PlinyCompute: A Platform for High-Performance, Distributed, Data-Intensive Tool Development 2018 SIGMOD 4.351469e-05
10,580 Quantum Data Management in the NISQ Era 2025 VLDB 4.1905499e-05
10,752 Robust Recursive Query Parallelism in Graph Database Management Systems 2025 VLDB 4.1905499e-05
11,001 Database Native Model Selection: Harnessing Deep Neural Networks in Database Systems 2024 VLDB 4.1905499e-05
11,475 Hybrid Evaluation for Distributed Iterative Matrix Computation 2021 SIGMOD 4.1905499e-05
11,867 dmapply: A functional primitive to express distributed machine learning algorithms in R 2016 VLDB 4.1905499e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 16 of 16 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
3 Pig Latin: A Not-So-Foreign Language for Data Processing 2008 SIGMOD 0.0024217964
39 Distributed GraphLab: A Framework for Machine Learning and Data Mining in the Cloud 2012 VLDB 0.00075263552
70 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB 0.00059744625
169 MAD Skills: New Analysis Practices for Big Data 2009 VLDB 0.00038967371
543 MLbase: A Distributed Machine-learning System 2013 CIDR 0.0002050918
866 Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs 2011 VLDB 0.00015771189
947 MRShare: Sharing Across Multiple Queries in MapReduce 2010 VLDB 0.00015112344
1,048 Starfish: A Self-tuning System for Big Data Analytics 2011 CIDR 0.00014442178
1,074 RIOT: I/O-Efficient Numerical Computing without SQL 2009 CIDR 0.00014238255
1,265 Jaql: A Scripting Language for Large Scale Semistructured Data Analysis 2011 VLDB 0.00012933537
1,494 Ricardo: Integrating R and Hadoop 2010 SIGMOD 0.00011677793
2,616 Opening the Black Boxes in Data Flow Optimization 2012 VLDB 8.4457819e-05
2,672 Cumulon: Optimizing Statistical Data Analysis in the Cloud 2013 SIGMOD 8.3334428e-05
2,754 Stubby: A Transformation-based Optimizer for MapReduce Workflows 2012 VLDB 8.1720428e-05
3,606 Large-Scale Machine Learning at Twitter 2012 SIGMOD 6.9246371e-05
4,254 Optimizing I/O for Big Array Analytics 2012 VLDB 6.3084831e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

Overall Rank Paper Year Venue Pagerank
9,269 Model-Parallel Model Selection for Deep Learning Systems 2021 SIGMOD 4.3633561e-05
2,823 Implicit Parallelism through Deep Language Embedding 2015 SIGMOD 8.0593793e-05
42 A Comparison of Approaches to Large-Scale Data Analysis 2009 SIGMOD 0.00073570328
543 MLbase: A Distributed Machine-learning System 2013 CIDR 0.0002050918
6,194 Automatic Optimization of Matrix Implementations for Distributed Machine Learning and Linear Algebra 2021 SIGMOD 5.1592984e-05
11,475 Hybrid Evaluation for Distributed Iterative Matrix Computation 2021 SIGMOD 4.1905499e-05
9,225 Towards an Optimized GROUP BY Abstraction for Large-Scale Machine Learning 2021 VLDB 4.3656789e-05
4,807 Resource Elasticity for Large-Scale Machine Learning 2015 SIGMOD 5.9045148e-05
3,920 On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML 2018 VLDB 6.6246708e-05
557 SystemML: Declarative Machine Learning on Spark 2016 VLDB 0.00020186115