DBScholar

Back to papers

SystemML: Declarative Machine Learning on Spark

Summary: Declarative ML via SystemML's DSL for linear algebra lets data scientists express custom algorithms while Spark uses cost-based plans. End-to-end Spark integration yields in-memory and scalable plans; open-source with optimizer/runtime insights for research. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h925b54aabed93192
Venue
VLDB
Year
2016
Pagerank
0.00018619173
Overall Rank
415 | 97.22%
DOI
10.14778/3007263.3007273
PDF
Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{boehm_vldb16,
        title = {{SystemML: Declarative Machine Learning on Spark}},
        author = {Boehm, Matthias and Dusenberry, Michael W. and Eriksson, Deron and Evfimievski, Alexandre V. and Manshadi, Faraz Makari and Pansare, Niketan and Reinwald, Berthold and Reiss, Frederick R. and Sen, Prithviraj and Surve, Arvind C. and Tatikonda, Shirish},
        journal = {PVLDB},
        series = {{VLDB} '16},
        volume = {9},
        number = {13},
        pages = {1425--1436},
        doi = {10.14778/3007263.3007273},
        url = {https://doi.org/10.14778/3007263.3007273},
        year = {2016}
}

Incoming Citations (Sorted by Pagerank)

Showing 50 of 65 citing papers.

Rank Citing Paper Year Venue Pagerank
1,200 Towards Linear Algebra over Normalized Data 2017 VLDB 0.00011524945
1,226 Data Management in Machine Learning: Challenges, Techniques, and Systems 2017 SIGMOD 0.00011432354
1,369 Towards Model-based Pricing for Machine Learning in a Data Marketplace 2019 SIGMOD 0.00010876597
1,616 SystemDS: A Declarative Machine Learning System for the End-to-End Data Science Lifecycle 2020 CIDR 0.00010048776
1,938 Elastic Machine Learning Algorithms in Amazon SageMaker 2020 SIGMOD 9.3316919e-05
2,031 Ease.ml: Towards Multi-tenant Resource Sharing for Machine Learning Workloads 2018 VLDB 9.1414653e-05
2,199 Extending Relational Query Processing with ML Inference 2020 CIDR 8.8664379e-05
2,204 Enabling and Optimizing Non-linear Feature Interactions in Factorized Linear Algebra 2019 SIGMOD 8.8531297e-05
2,278 An Intermediate Representation for Optimizing Machine Learning Pipelines 2019 VLDB 8.6993865e-05
2,341 SliceLine: Fast, Linear-Algebra-based Slice Finding for ML Model Debugging 2021 SIGMOD 8.5984124e-05
2,464 Query Processing on Tensor Computation Runtimes 2022 VLDB 8.4081954e-05
2,473 Complaint-driven Training Data Debugging for Query 2.0 2020 SIGMOD 8.3984284e-05
2,528 Fractal: A General-Purpose Graph Pattern Mining System 2019 SIGMOD 8.3237453e-05
2,672 End-to-end Optimization of Machine Learning Prediction Queries 2022 SIGMOD 8.1301225e-05
2,673 A Layered Aggregate Engine for Analytics Workloads 2019 SIGMOD 8.1276375e-05
2,834 DB4ML – An In-Memory Database Kernel with Machine Learning Support 2020 SIGMOD 7.9442734e-05
2,913 AI Meets Database: AI4DB and DB4AI 2021 SIGMOD 7.855786e-05
3,104 On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML 2018 VLDB 7.6281929e-05
3,331 SPOOF: Sum-Product Optimization and Operator Fusion for Large-Scale Machine Learning 2017 CIDR 7.4065701e-05
3,416 RHEEM: Enabling Cross-Platform Data Processing - May The Big Data Be With You! - 2018 VLDB 7.3046808e-05
3,528 A Comparative Evaluation of Systems for Scalable Linear Algebra-based Analytics 2018 VLDB 7.2134232e-05
3,674 Are Key-Foreign Key Joins Safe to Avoid when Learning High-Capacity Classifiers? 2018 VLDB 7.090133e-05
4,117 Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches 2021 VLDB 6.784003e-05
4,329 MNC: Structure-Exploiting Sparsity Estimation for Matrix Expressions 2019 SIGMOD 6.64569e-05
4,354 LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems 2021 SIGMOD 6.6318545e-05
4,670 Automatically Leveraging MapReduce Frameworks for Data-Intensive Applications 2018 SIGMOD 6.4607221e-05
4,687 Data Platform for Machine Learning 2019 SIGMOD 6.4518327e-05
5,291 InferDB: In-Database Machine Learning Inference Using Indexes 2024 VLDB 6.178665e-05
5,454 PS2: Parameter Server on Spark 2019 SIGMOD 6.1077156e-05
5,505 Automatic Optimization of Matrix Implementations for Distributed Machine Learning and Linear Algebra 2021 SIGMOD 6.0884328e-05
5,885 BlinkML: Efficient Maximum Likelihood Estimation with Probabilistic Guarantees 2019 SIGMOD 5.9421702e-05
6,011 BAGUA: Scaling up Distributed Learning with System Relaxations 2022 VLDB 5.8975241e-05
6,562 JoinBoost: Grow Trees Over Normalized Data Using Only SQL 2023 VLDB 5.7287508e-05
6,654 Coresets over Multiple Tables for Feature-rich and Data-efficient Machine Learning 2023 VLDB 5.7038474e-05
6,679 UPLIFT: Parallelization Strategies for Feature Transformations in Machine Learning Workloads 2022 VLDB 5.6956362e-05
6,733 DistME: A Fast and Elastic Distributed Matrix Computation Engine using GPUs 2019 SIGMOD 5.6788432e-05
6,861 Serving Deep Learning Models with Deduplication from Relational Databases 2022 VLDB 5.6460409e-05
7,168 A Cost-based Optimizer for Gradient Descent Optimization 2017 SIGMOD 5.5794432e-05
7,405 Lachesis: Automatic Partitioning for UDF-Centric Analytics 2021 VLDB 5.5172664e-05
7,482 M2Bench: A Database Benchmark for Multi-Model Analytic Workloads 2023 VLDB 5.5009081e-05
7,635 The Machine Learning Bazaar: Harnessing the ML Ecosystem for Effective System Development 2020 SIGMOD 5.46321e-05
8,407 AWARE: Workload-aware, Redundancy-exploiting Linear Algebra 2023 SIGMOD 5.3219903e-05
8,545 FuseME: Distributed Matrix Computation Engine based on Cuboid-based Fused Operator and Plan Generation 2022 SIGMOD 5.3036987e-05
8,710 Galley: Modern Query Optimization for Sparse Tensor Programs 2025 SIGMOD 5.2705676e-05
8,796 PreVision: An Out-of-Core Matrix Computation System with Optimal Buffer Replacement 2024 SIGMOD 5.261449e-05
9,048 The Power of Nested Parallelism in Big Data Processing – Hitting Three Flies with One Slap – 2021 SIGMOD 5.2155403e-05
9,101 Privacy and Accuracy-Aware AI/ML Model Deduplication 2025 SIGMOD 5.208561e-05
9,190 HADAD: A Lightweight Approach for Optimizing Hybrid Complex Analytics Queries 2021 SIGMOD 5.1972757e-05
9,285 Leveraging Similarity Joins for Signal Reconstruction 2018 VLDB 5.1860131e-05
9,589 Towards an Optimized GROUP BY Abstraction for Large-Scale Machine Learning 2021 VLDB 5.1377385e-05
Previous Page 1 / 2 Next

Outgoing Citations (Sorted by Pagerank)

Showing 12 of 12 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
22 Distributed GraphLab: A Framework for Machine Learning and Data Mining in the Cloud 2012 VLDB 0.00056028465
105 The MADlib Analytics Library or MAD Skills, the SQL 2012 VLDB 0.00033605348
538 MLbase: A Distributed Machine-learning System 2013 CIDR 0.00016725463
656 Materialization Optimizations for Feature Selection Workloads 2014 SIGMOD 0.00015052106
1,009 Simulation of Database-Valued Markov Chains Using SimSQL 2013 SIGMOD 0.00012518224
1,083 Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML 2014 VLDB 0.00012089325
1,449 An Architecture for Compiling UDF-centric Workflows 2015 VLDB 0.00010597074
2,250 Cumulon: Optimizing Statistical Data Analysis in the Cloud 2013 SIGMOD 8.7477605e-05
2,720 Exploiting Matrix Dependency for Efficient Distributed Matrix Computation 2015 SIGMOD 8.0778267e-05
2,758 Implicit Parallelism through Deep Language Embedding 2015 SIGMOD 8.0283838e-05
4,134 Resource Elasticity for Large-Scale Machine Learning 2015 SIGMOD 6.7721426e-05
6,531 REEF: Retainable Evaluator Execution Framework 2015 SIGMOD 5.7363332e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 2,834 DB4ML – An In-Memory Database Kernel with Machine Learning Support 2020 SIGMOD
2 4,134 Resource Elasticity for Large-Scale Machine Learning 2015 SIGMOD
3 3,528 A Comparative Evaluation of Systems for Scalable Linear Algebra-based Analytics 2018 VLDB
4 1,128 Structured Streaming: A Declarative API for Real-Time Applications in Apache Spark 2018 SIGMOD
5 11,759 ST4ML: Machine Learning Oriented Spatio-Temporal Data Processing at Scale 2023 SIGMOD
6 2,644 Big Data Analytics with Datalog Queries on Spark 2016 SIGMOD
7 538 MLbase: A Distributed Machine-learning System 2013 CIDR
8 3,104 On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML 2018 VLDB
9 1,616 SystemDS: A Declarative Machine Learning System for the End-to-End Data Science Lifecycle 2020 CIDR
10 1,083 Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML 2014 VLDB