Saturn: An Optimized Data System for Multi-Large-Model Deep Learning Workloads

Summary: Formalizes SPASE: jointly select parallelism, allocate GPUs, and schedule multi-model DL experiments via a template plus an empirical profiler. Solves SPASE as an MILP (beats heuristics) with introspective scheduling in Saturn, reducing model-selection runtime by 39–49%. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 13936
Venue: VLDB
Year: 2024
Pagerank: 5.227679e-05
Overall Rank: 9,737 | 33.20%
DOI: 10.14778/3636218.3636227

Incoming Non-self Citations Over Time

Authors

1. Kabir Nagrecha (University of California San Diego)
2. Arun Kumar (University of California San Diego)

BibTeX Citation

@article{nagrecha_vldb24,
        title = {{Saturn: An Optimized Data System for Multi-Large-Model Deep Learning Workloads}},
        author = {Nagrecha, Kabir and Kumar, Arun},
        journal = {PVLDB},
        series = {{VLDB} '24},
        volume = {17},
        number = {4},
        pages = {712--725},
        doi = {10.14778/3636218.3636227},
        url = {https://doi.org/10.14778/3636218.3636227},
        year = {2024}
}

Incoming Citations (Sorted by Pagerank)

Showing 2 of 2 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
6,588	Lotan: Bridging the Gap between GNNs and Scalable Graph Analytics Engines	2023	VLDB	5.833338e-05
10,481	Performant Synchronization in Geo-Distributed Databases	2026	SIGMOD	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 6 of 6 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
86	Automatic Database Management System Tuning Through Large-scale Machine Learning	2017	SIGMOD	0.00035316107
521	PyTorch Distributed: Experiences on Accelerating Data Parallel Training	2020	VLDB	0.0001713368
923	Starfish: A Self-tuning System for Big Data Analytics	2011	CIDR	0.00013189886
6,022	NuPS: A Parameter Server for Machine Learning with Non-Uniform Parameter Access	2022	SIGMOD	6.0046123e-05
8,979	Cerebro: A Layered Data Platform for Scalable Deep Learning	2021	CIDR	5.3399615e-05
9,414	Model-Parallel Model Selection for Deep Learning Systems	2021	SIGMOD	5.2743893e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	10,228	Efficient LLM Serving for Agentic Workflows: A Data Systems Perspective	2026	SIGMOD
2	1,079	Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML	2014	VLDB
3	7,656	Nautilus: An Optimized System for Deep Transfer Learning over Evolving Training Datasets	2022	SIGMOD
4	9,414	Model-Parallel Model Selection for Deep Learning Systems	2021	SIGMOD
5	9,371	Towards an Optimized GROUP BY Abstraction for Large-Scale Machine Learning	2021	VLDB
6	1,157	Cerebro: A Data System for Optimized Deep Learning Model Selection	2020	VLDB
7	10,219	DFLOP: A Data-driven Framework for Multimodal LLM Training Pipeline Optimization	2026	SIGMOD
8	4,067	Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches	2021	VLDB
9	13,375	Reimagining Deep Learning Systems Through the Lens of Data Systems	2024	VLDB
10	5,003	Galvatron: Efficient Transformer Training over Multiple GPUs Using Automatic Parallelism	2023	VLDB