DBScholar

Back to papers

SystemDS: A Declarative Machine Learning System for the End-to-End Data Science Lifecycle

Summary: SystemDS is an open-source declarative ML system that unifies the end-to-end data science lifecycle—data integration, cleaning, preparation, local/distributed/federated training, debugging, and serving—via a stack of language abstractions. It targets lifecycle-wide optimization to eliminate boundary crossing between data engineering and modeling, building on SystemML lessons to support heterogeneous data and diverse user expertise. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID
h36134b1b17ad0557
Venue
CIDR
Year
2020
Pagerank
0.00010048776
Overall Rank
1,616 | 89.17%
DOI
-
PDF
Download (CC BY 3.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{boehm_cidr20,
        address = {Amsterdam, Netherlands},
        series = {{CIDR} '20},
        title = {{SystemDS: A Declarative Machine Learning System for the End-to-End Data Science Lifecycle}},
        booktitle = {Proceedings of the {Conference} on {Innovative} {Data} {Systems} {Research}},
        author = {Boehm, Matthias and Antonov, Iulian and Baunsgaard, Sebastian and Dokter, Mark and Ginthör, Robert and Innerebner, Kevin and Klezin, Florijan and Lindstaedt, Stefanie and Phani, Arnab and Rath, Benjamin and Reinwald, Berthold and Siddiqi, Shafaq and Wrede, Sebastian Benjamin},
        year = {2020}
}

Incoming Citations (Sorted by Pagerank)

Showing 33 of 33 citing papers.

Rank Citing Paper Year Venue Pagerank
1,938 Elastic Machine Learning Algorithms in Amazon SageMaker 2020 SIGMOD 9.3316919e-05
2,341 SliceLine: Fast, Linear-Algebra-based Slice Finding for ML Model Debugging 2021 SIGMOD 8.5984124e-05
2,464 Query Processing on Tensor Computation Runtimes 2022 VLDB 8.4081954e-05
3,340 VolcanoML: Speeding up End-to-End AutoML via Scalable Search Space Decomposition 2021 VLDB 7.3886578e-05
4,354 LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems 2021 SIGMOD 6.6318545e-05
5,230 Saga: A Scalable Framework for Optimizing Data Cleaning Pipelines for Machine Learning Applications 2023 SIGMOD 6.2059854e-05
6,438 CtxPipe: Context-aware Data Preparation Pipeline Construction for Machine Learning 2024 SIGMOD 5.7678369e-05
6,679 UPLIFT: Parallelization Strategies for Feature Transformations in Machine Learning Workloads 2022 VLDB 5.6956362e-05
6,902 DAPHNE: An Open and Extensible System Infrastructure for Integrated Data Analysis Pipelines 2022 CIDR 5.6365602e-05
7,297 SubStrat: A Subset-Based Optimization Strategy for Faster AutoML 2023 VLDB 5.5469403e-05
7,558 Automating and Optimizing Data-Centric What-If Analyses on Native Machine Learning Pipelines 2023 SIGMOD 5.4788791e-05
7,860 ExDRa: Exploratory Data Science on Federated Raw Data 2021 SIGMOD 5.422643e-05
8,298 Hyper-Tune: Towards Efficient Hyper-parameter Tuning at Scale 2022 VLDB 5.3437127e-05
8,545 FuseME: Distributed Matrix Computation Engine based on Cuboid-based Fused Operator and Plan Generation 2022 SIGMOD 5.3036987e-05
8,710 Galley: Modern Query Optimization for Sparse Tensor Programs 2025 SIGMOD 5.2705676e-05
8,796 PreVision: An Out-of-Core Matrix Computation System with Optimal Buffer Replacement 2024 SIGMOD 5.261449e-05
9,571 GIO: Generating Efficient Matrix and Frame Readers for Custom Data Formats by Example 2023 SIGMOD 5.1430298e-05
9,589 Towards an Optimized GROUP BY Abstraction for Large-Scale Machine Learning 2021 VLDB 5.1377385e-05
9,842 CatDB: Data-catalog-guided, LLM-based Generation of Data-centric ML Pipelines 2025 VLDB 5.1064323e-05
10,062 EinDecomp: Decomposition of Declaratively-Specified Machine Learning and Numerical Computations for Parallel Execution 2025 VLDB 5.0751118e-05
10,397 FlowPipe: LLM-Enhanced Conditional Generative Flow Networks for Data Preparation Pipeline Construction 2027 SIGMOD 4.9605343e-05
10,525 EncoderForge: Generating Efficient SQL for Encoders in Machine Learning Inference Pipelines 2026 SIGMOD 4.9605343e-05
10,725 InferF: Declarative Factorization of AI/ML Inferences over Joins 2026 SIGMOD 4.9605343e-05
10,770 Automated Tensor-Relational Decomposition for Large-Scale Sparse Tensor Computation 2026 VLDB 4.9605343e-05
10,968 stratum: A System Infrastructure for Massive Agent-Centric ML Workloads 2026 VLDB 4.9605343e-05
10,996 Benchmarking Native In-Database TPCx-AI at 100 Terabytes in Ocient Hyperscale Data Warehouse: An Eight-Use-Case Study of Classical and Statistical ML on Relational Primitives 2026 VLDB 4.9605343e-05
11,015 Morphing-based Compression for Data-centric ML Pipelines 2026 VLDB 4.9605343e-05
11,299 A Systematic Study on Early Stopping Metrics in HPO and the Implications of Uncertainty 2025 VLDB 4.9605343e-05
11,307 Quantum Data Management in the NISQ Era 2025 VLDB 4.9605343e-05
11,847 To UDFs and Beyond: Demonstration of a Fully Decomposed Data Processor for General Data Wrangling Tasks 2023 VLDB 4.9605343e-05
11,896 Redundancy Elimination in Distributed Matrix Computation 2022 SIGMOD 4.9605343e-05
11,958 ReMac: A Matrix Computation System with Redundancy Elimination 2022 VLDB 4.9605343e-05
12,031 Enforcing Constraints for Machine Learning Systems via Declarative Feature Selection: An Experimental Study 2021 SIGMOD 4.9605343e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 38 of 38 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
95 Potter's Wheel: An Interactive Data Cleaning System 2001 VLDB 0.00034319763
100 HoloClean: Holistic Data Repairs with Probabilistic Inference 2017 VLDB 0.00033951027
105 The MADlib Analytics Library or MAD Skills, the SQL 2012 VLDB 0.00033605348
154 MAD Skills: New Analysis Practices for Big Data 2009 VLDB 0.00028524078
415 SystemML: Declarative Machine Learning on Spark 2016 VLDB 0.00018619173
506 Towards a Unified Architecture for in-RDBMS Analytics 2012 SIGMOD 0.00017158546
522 Learning Linear Regression Models over Factorized Joins 2016 SIGMOD 0.00016893112
656 Materialization Optimizations for Feature Selection Workloads 2014 SIGMOD 0.00015052106
731 Learning Generalized Linear Models Over Normalized Data 2015 SIGMOD 0.00014363943
795 Model Management 2.0: Manipulating Richer Mappings 2007 SIGMOD 0.00013895182
853 HoloDetect: Few-Shot Learning for Error Detection 2019 SIGMOD 0.00013437314
879 Interpretable and Informative Explanations of Outcomes 2015 VLDB 0.00013255435
948 Democratizing Data Science through Interactive Curation of ML Pipelines 2019 SIGMOD 0.00012900728
1,072 NoDB: Efficient Query Execution on Raw Data Files 2012 SIGMOD 0.00012143482
1,083 Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML 2014 VLDB 0.00012089325
1,197 Weld: A Common Runtime for High Performance Data Analytics 2017 CIDR 0.00011548039
1,278 Automating Large-Scale Data Quality Verification 2018 VLDB 0.00011208469
1,416 Northstar: An Interactive Data Science System 2018 VLDB 0.00010707248
1,567 HELIX: Holistic Optimization for Accelerating Iterative Machine Learning 2019 VLDB 0.00010179013
1,615 Compressed Linear Algebra for Large-Scale Machine Learning 2016 VLDB 0.00010054378
1,699 MISTIQUE: A System to Store and Query Model Intermediates for Model Diagnosis 2018 SIGMOD 9.8230859e-05
1,875 Predictive Interaction for Data Transformation 2015 CIDR 9.4433754e-05
1,985 Sato: Contextual Semantic Type Detection in Tables 2020 VLDB 9.2378767e-05
2,092 An Architecture for Recycling Intermediates in a Column-store 2009 SIGMOD 9.0432353e-05
2,252 Query Optimization for Dynamic Imputation 2017 VLDB 8.7454369e-05
2,278 An Intermediate Representation for Optimizing Machine Learning Pipelines 2019 VLDB 8.6993865e-05
2,356 Filter Before You Parse: Faster Analytics on Raw Data with Sparser 2018 VLDB 8.5715425e-05
2,783 AIDA - Abstraction for Advanced In-Database Analytics 2018 VLDB 8.0027405e-05
3,104 On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML 2018 VLDB 7.6281929e-05
3,122 Incremental View Maintenance with Triple Lock Factorization Benefits 2018 SIGMOD 7.6091671e-05
3,510 Fast Queries Over Heterogeneous Data Through Engine Customization 2016 VLDB 7.2263115e-05
3,565 WANalytics: Analytics for a Geo-Distributed Data-Intensive World 2015 CIDR 7.183429e-05
4,134 Resource Elasticity for Large-Scale Machine Learning 2015 SIGMOD 6.7721426e-05
4,186 Data Integration and Machine Learning: A Natural Synergy 2018 SIGMOD 6.7408641e-05
4,329 MNC: Structure-Exploiting Sparsity Estimation for Matrix Expressions 2019 SIGMOD 6.64569e-05
4,993 GLADE: Big Data Analytics Made Easy 2012 SIGMOD 6.3109925e-05
8,387 Meta-Dataflows: Efficient Exploratory Dataflow Jobs 2018 SIGMOD 5.325795e-05
9,826 BlockJoin: Efficient Matrix Partitioning Through Joins 2017 VLDB 5.1083104e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 9,454 Towards Observability for Production Machine Learning Pipelines 2022 VLDB
2 1,083 Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML 2014 VLDB
3 6,095 From Auto-tuning One Size Fits All to Self-designed and Learned Data-intensive Systems 2019 SIGMOD
4 8,502 Deep Learning: Systems and Responsibility 2021 SIGMOD
5 7,635 The Machine Learning Bazaar: Harnessing the ML Ecosystem for Effective System Development 2020 SIGMOD
6 5,982 Towards instance-optimized data systems 2021 VLDB
7 538 MLbase: A Distributed Machine-learning System 2013 CIDR
8 4,687 Data Platform for Machine Learning 2019 SIGMOD
9 13,734 Reimagining Deep Learning Systems Through the Lens of Data Systems 2024 VLDB
10 415 SystemML: Declarative Machine Learning on Spark 2016 VLDB