SystemML: Declarative Machine Learning on Spark

Summary: Declarative ML via SystemML's DSL for linear algebra lets data scientists express custom algorithms while Spark uses cost-based plans. End-to-end Spark integration yields in-memory and scalable plans; open-source with optimizer/runtime insights for research. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h925b54aabed93192
Venue: VLDB
Year: 2016
Pagerank: 0.00018619173
Overall Rank: 415 | 97.22%
DOI: 10.14778/3007263.3007273
PDF: Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

1. Matthias Boehm (IBM)
2. Michael W. Dusenberry (IBM Spark Technology Center)
3. Deron Eriksson (IBM Spark Technology Center)
4. Alexandre V. Evfimievski (IBM)
5. Faraz Makari Manshadi (IBM)
6. Niketan Pansare (IBM)
7. Berthold Reinwald (IBM)
8. Frederick R. Reiss (IBM; IBM Spark Technology Center)
9. Prithviraj Sen (IBM)
10. Arvind C. Surve (IBM Spark Technology Center)
11. Shirish Tatikonda (IBM; Target Corporation)

BibTeX Citation

@article{boehm_vldb16,
        title = {{SystemML: Declarative Machine Learning on Spark}},
        author = {Boehm, Matthias and Dusenberry, Michael W. and Eriksson, Deron and Evfimievski, Alexandre V. and Manshadi, Faraz Makari and Pansare, Niketan and Reinwald, Berthold and Reiss, Frederick R. and Sen, Prithviraj and Surve, Arvind C. and Tatikonda, Shirish},
        journal = {PVLDB},
        series = {{VLDB} '16},
        volume = {9},
        number = {13},
        pages = {1425--1436},
        doi = {10.14778/3007263.3007273},
        url = {https://doi.org/10.14778/3007263.3007273},
        year = {2016}
}

Incoming Citations (Sorted by Pagerank)

Showing 15 of 65 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
9,785	PlinyCompute: A Platform for High-Performance, Distributed, Data-Intensive Tool Development	2018	SIGMOD	5.115551e-05
9,826	BlockJoin: Efficient Matrix Partitioning Through Joins	2017	VLDB	5.1083104e-05
9,964	Unified Data Analytics: State-of-the-art and Open Problems	2022	VLDB	5.0910746e-05
10,218	In-Database Data Imputation	2024	SIGMOD	5.0461625e-05
10,725	InferF: Declarative Factorization of AI/ML Inferences over Joins	2026	SIGMOD	4.9605343e-05
10,968	stratum: A System Infrastructure for Massive Agent-Centric ML Workloads	2026	VLDB	4.9605343e-05
11,015	Morphing-based Compression for Data-centric ML Pipelines	2026	VLDB	4.9605343e-05
11,180	LCP: Enhancing Scientific Data Management with Lossy Compression for Particles	2025	SIGMOD	4.9605343e-05
11,728	Templating Shuffles	2023	CIDR	4.9605343e-05
11,896	Redundancy Elimination in Distributed Matrix Computation	2022	SIGMOD	4.9605343e-05
11,898	Juggler: Autonomous Cost Optimization and Performance Prediction of Big Data Applications	2022	SIGMOD	4.9605343e-05
12,026	Hybrid Evaluation for Distributed Iterative Matrix Computation	2021	SIGMOD	4.9605343e-05
12,031	Enforcing Constraints for Machine Learning Systems via Declarative Feature Selection: An Experimental Study	2021	SIGMOD	4.9605343e-05
12,063	HyMAC: A Hybrid Matrix Computation System	2021	VLDB	4.9605343e-05
12,141	TRACER: A Framework for Facilitating Accurate and Interpretable Analytics for High Stakes Applications	2020	SIGMOD	4.9605343e-05

Outgoing Citations (Sorted by Pagerank)

Showing 12 of 12 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
22	Distributed GraphLab: A Framework for Machine Learning and Data Mining in the Cloud	2012	VLDB	0.00056028465
105	The MADlib Analytics Library or MAD Skills, the SQL	2012	VLDB	0.00033605348
538	MLbase: A Distributed Machine-learning System	2013	CIDR	0.00016725463
656	Materialization Optimizations for Feature Selection Workloads	2014	SIGMOD	0.00015052106
1,009	Simulation of Database-Valued Markov Chains Using SimSQL	2013	SIGMOD	0.00012518224
1,083	Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML	2014	VLDB	0.00012089325
1,449	An Architecture for Compiling UDF-centric Workflows	2015	VLDB	0.00010597074
2,250	Cumulon: Optimizing Statistical Data Analysis in the Cloud	2013	SIGMOD	8.7477605e-05
2,720	Exploiting Matrix Dependency for Efficient Distributed Matrix Computation	2015	SIGMOD	8.0778267e-05
2,758	Implicit Parallelism through Deep Language Embedding	2015	SIGMOD	8.0283838e-05
4,134	Resource Elasticity for Large-Scale Machine Learning	2015	SIGMOD	6.7721426e-05
6,531	REEF: Retainable Evaluator Execution Framework	2015	SIGMOD	5.7363332e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	2,834	DB4ML – An In-Memory Database Kernel with Machine Learning Support	2020	SIGMOD
2	4,134	Resource Elasticity for Large-Scale Machine Learning	2015	SIGMOD
3	3,528	A Comparative Evaluation of Systems for Scalable Linear Algebra-based Analytics	2018	VLDB
4	1,128	Structured Streaming: A Declarative API for Real-Time Applications in Apache Spark	2018	SIGMOD
5	11,759	ST4ML: Machine Learning Oriented Spatio-Temporal Data Processing at Scale	2023	SIGMOD
6	2,644	Big Data Analytics with Datalog Queries on Spark	2016	SIGMOD
7	538	MLbase: A Distributed Machine-learning System	2013	CIDR
8	3,104	On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML	2018	VLDB
9	1,616	SystemDS: A Declarative Machine Learning System for the End-to-End Data Science Lifecycle	2020	CIDR
10	1,083	Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML	2014	VLDB