DBScholar

Back to papers

Optimizing Machine Learning Workloads in Collaborative Environments

Summary: Introduces Experiment Graph (EG) to persist artifacts (data/models) as vertices and ML operations as edges for collaborative ML workloads. Proposes two materialization strategies and a linear-time reuse algorithm to cache artifacts and plan execution, yielding up to 10x speedups on repeats and ~50% on edits. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h97d57e7787af0a3e
Venue
SIGMOD
Year
2020
Pagerank
5.99349e-05
Overall Rank
5,792 | 61.06%
DOI
10.1145/3318464.3389715

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{derakhshan_sigmod20,
        title = {{Optimizing Machine Learning Workloads in Collaborative Environments}},
        author = {Derakhshan, Behrouz and Mahdiraji, Alireza Rezaei and Abedjan, Ziawasch and Rabl, Tilmann and Markl, Volker},
        series = {{SIGMOD} '20},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3318464.3389715},
        url = {https://dl.acm.org/doi/10.1145/3318464.3389715},
        year = {2020}
}

Incoming Citations (Sorted by Pagerank)

Showing 11 of 11 citing papers.

Rank Citing Paper Year Venue Pagerank
3,399 Orca: Scalable Temporal Graph Neural Network Training with Theoretical Guarantees 2023 SIGMOD 7.3349076e-05
4,095 Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches 2021 VLDB 6.8095767e-05
4,334 LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems 2021 SIGMOD 6.6569314e-05
6,217 Materialization and Reuse Optimizations for Production Data Science Pipelines 2022 SIGMOD 5.8474357e-05
6,662 UPLIFT: Parallelization Strategies for Feature Transformations in Machine Learning Workloads 2022 VLDB 5.7171651e-05
7,839 ExDRa: Exploratory Data Science on Federated Raw Data 2021 SIGMOD 5.4432099e-05
10,722 CAPS: Cost-Aware ML Pipeline Selection 2026 VLDB 4.9793485e-05
11,176 Alsatian: Optimizing Model Search for Deep Transfer Learning 2025 SIGMOD 4.9793485e-05
11,426 ML-Asset Management: Curation, Discovery, and Utilization 2025 VLDB 4.9793485e-05
11,981 Enforcing Constraints for Machine Learning Systems via Declarative Feature Selection: An Experimental Study 2021 SIGMOD 4.9793485e-05
13,593 Demonstrating EarthLake: A Model Lake System for Earth Observation Foundation Model Management 2026 VLDB -
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 10 of 10 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
654 Materialization Optimizations for Feature Selection Workloads 2014 SIGMOD 0.0001510357
975 Democratizing Data Science through Interactive Curation of ML Pipelines 2019 SIGMOD 0.00012750518
1,086 DataHub: Collaborative Data Science & Dataset Version Management at Scale 2015 CIDR 0.0001210322
1,355 Principles of Dataset Versioning: Exploring the Recreation/Storage Tradeoff 2015 VLDB 0.0001092646
1,568 HELIX: Holistic Optimization for Accelerating Iterative Machine Learning 2019 VLDB 0.0001021302
1,691 MISTIQUE: A System to Store and Query Model Intermediates for Model Diagnosis 2018 SIGMOD 9.8570722e-05
1,880 Ground: A Data Context Service 2017 CIDR 9.4415148e-05
1,924 ReStore: Reusing Results of MapReduce Jobs 2012 VLDB 9.3687009e-05
3,167 HELIX: Accelerating Human-in-the-loop Machine Learning 2018 VLDB 7.5728577e-05
7,208 Dataset Relationship Management 2019 CIDR 5.584745e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 4,672 Data Platform for Machine Learning 2019 SIGMOD
2 9,556 Towards an Optimized GROUP BY Abstraction for Large-Scale Machine Learning 2021 VLDB
3 4,334 LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems 2021 SIGMOD
4 1,355 Principles of Dataset Versioning: Exploring the Recreation/Storage Tradeoff 2015 VLDB
5 2,036 Ease.ml: Towards Multi-tenant Resource Sharing for Machine Learning Workloads 2018 VLDB
6 13,783 Towards Scalable Online Machine Learning Collaborations with OpenML 2021 VLDB
7 4,116 Resource Elasticity for Large-Scale Machine Learning 2015 SIGMOD
8 2,187 Production Machine Learning Pipelines: Empirical Analysis and Optimization Opportunities 2021 SIGMOD
9 6,143 Efficient Construction of Approximate Ad-Hoc ML models Through Materialization and Reuse 2018 VLDB
10 6,217 Materialization and Reuse Optimizations for Production Data Science Pipelines 2022 SIGMOD