Nautilus: An Optimized System for Deep Transfer Learning over Evolving Training Datasets

Summary: Frames DTL adaptation with frozen pre-trained layers as a multi-query optimization problem and introduces two optimizations to share computations across model selections on evolving labeled data. Implemented in Nautilus, it yields up to 5x speedup over naive re-training on benchmark workloads. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 6299
Venue: SIGMOD
Year: 2022
Pagerank: 4.6826896e-05
Overall Rank: 7,656 | 46.80%
DOI: 10.1145/3514221.3517846

Incoming Non-self Citations Over Time

Authors

1. Supun Nakandala
2. Arun Kumar

Incoming Citations (Sorted by Pagerank)

Showing 5 of 5 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
6,885	Lotan: Bridging the Gap between GNNs and Scalable Graph Analytics Engines	2023	VLDB	4.8908367e-05
9,787	The Image Calculator: 10x Faster Image-AI Inference by Replacing JPEG with Self-designing Storage Format	2024	SIGMOD	4.2799988e-05
10,479	Alsatian: Optimizing Model Search for Deep Transfer Learning	2025	SIGMOD	4.1905499e-05
10,979	StarfishDB: a Query Execution Engine for Relational Probabilistic Programming	2024	SIGMOD	4.1905499e-05
13,185	Reimagining Deep Learning Systems Through the Lens of Data Systems	2024	VLDB	-

Outgoing Citations (Sorted by Pagerank)

Showing 11 of 11 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
252	Snorkel: Rapid Training Data Creation with Weak Supervision	2018	VLDB	0.00030532082
684	Cerebro: A Data System for Optimized Deep Learning Model Selection	2020	VLDB	0.00018152321
758	Materialization Optimizations for Feature Selection Workloads	2014	SIGMOD	0.00017053915
977	Pipelining in Multi-Query Optimization	2001	PODS	0.000148774
1,500	Analyzing and Mitigating Data Stalls in DNN Training	2021	VLDB	0.00011636174
1,666	HELIX: Holistic Optimization for Accelerating Iterative Machine Learning	2019	VLDB	0.00010955907
2,157	MISTIQUE: A System to Store and Query Model Intermediates for Model Diagnosis	2018	SIGMOD	9.4153917e-05
2,892	VISTA: Optimized System for Declarative Feature Transfer from Deep CNNs at Scale	2020	SIGMOD	7.9570135e-05
4,601	Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches	2021	VLDB	6.05274e-05
4,779	LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems	2021	SIGMOD	5.9259373e-05
9,225	Towards an Optimized GROUP BY Abstraction for Large-Scale Machine Learning	2021	VLDB	4.3656789e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
9,775	Structure-Aware Machine Learning over Multi-Relational Databases	2021	SIGMOD	4.2815042e-05
4,601	Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches	2021	VLDB	6.05274e-05
7,055	Serving Deep Learning Models with Deduplication from Relational Databases	2022	VLDB	4.8428976e-05
3,694	Where Is My Training Bottleneck? Hidden Trade-Offs in Deep Learning Preprocessing Pipelines	2022	SIGMOD	6.8316905e-05
9,603	Saturn: An Optimized Data System for Multi-Large-Model Deep Learning Workloads	2024	VLDB	4.3136057e-05
10,479	Alsatian: Optimizing Model Search for Deep Transfer Learning	2025	SIGMOD	4.1905499e-05
9,269	Model-Parallel Model Selection for Deep Learning Systems	2021	SIGMOD	4.3633561e-05
9,117	Deep Query Optimization	2019	SIGMOD	4.3885415e-05
4,175	FastFlow: Accelerating Deep Learning Model Training with Smart Offloading of Input Data Pipeline	2023	VLDB	6.3772575e-05
13,185	Reimagining Deep Learning Systems Through the Lens of Data Systems	2024	VLDB	-