Nautilus: An Optimized System for Deep Transfer Learning over Evolving Training Datasets

Summary: Frames DTL adaptation with frozen pre-trained layers as a multi-query optimization problem and introduces two optimizations to share computations across model selections on evolving labeled data. Implemented in Nautilus, it yields up to 5x speedup over naive re-training on benchmark workloads. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 6298
Venue: SIGMOD
Year: 2022
Pagerank: 4.6871575e-05
Overall Rank: 7,656 | 46.74%
DOI: 10.1145/3514221.3517846

Incoming Non-self Citations Over Time

Authors

1. Supun Nakandala
2. Arun Kumar

Incoming Citations (Sorted by Pagerank)

Showing 5 of 5 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
6,884	Lotan: Bridging the Gap between GNNs and Scalable Graph Analytics Engines	2023	VLDB	4.8955332e-05
9,806	The Image Calculator: 10x Faster Image-AI Inference by Replacing JPEG with Self-designing Storage Format	2024	SIGMOD	4.2805224e-05
10,469	Alsatian: Optimizing Model Search for Deep Transfer Learning	2025	SIGMOD	4.1945683e-05
10,976	StarfishDB: a Query Execution Engine for Relational Probabilistic Programming	2024	SIGMOD	4.1945683e-05
13,171	Reimagining Deep Learning Systems Through the Lens of Data Systems	2024	VLDB	-

Outgoing Citations (Sorted by Pagerank)

Showing 11 of 11 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
254	Snorkel: Rapid Training Data Creation with Weak Supervision	2018	VLDB	0.00030540555
683	Cerebro: A Data System for Optimized Deep Learning Model Selection	2020	VLDB	0.00018195476
761	Materialization Optimizations for Feature Selection Workloads	2014	SIGMOD	0.00017053783
977	Pipelining in Multi-Query Optimization	2001	PODS	0.0001488881
1,504	Analyzing and Mitigating Data Stalls in DNN Training	2021	VLDB	0.00011642333
1,666	HELIX: Holistic Optimization for Accelerating Iterative Machine Learning	2019	VLDB	0.0001096361
2,152	MISTIQUE: A System to Store and Query Model Intermediates for Model Diagnosis	2018	SIGMOD	9.4239787e-05
2,886	VISTA: Optimized System for Declarative Feature Transfer from Deep CNNs at Scale	2020	SIGMOD	7.9612767e-05
4,557	Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches	2021	VLDB	6.087611e-05
4,774	LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems	2021	SIGMOD	5.9316087e-05
9,222	Towards an Optimized GROUP BY Abstraction for Large-Scale Machine Learning	2021	VLDB	4.3698672e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
9,776	Structure-Aware Machine Learning over Multi-Relational Databases	2021	SIGMOD	4.2856106e-05
4,557	Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches	2021	VLDB	6.087611e-05
7,061	Serving Deep Learning Models with Deduplication from Relational Databases	2022	VLDB	4.8463881e-05
3,698	Where Is My Training Bottleneck? Hidden Trade-Offs in Deep Learning Preprocessing Pipelines	2022	SIGMOD	6.8340435e-05
9,603	Saturn: An Optimized Data System for Multi-Large-Model Deep Learning Workloads	2024	VLDB	4.3177432e-05
10,469	Alsatian: Optimizing Model Search for Deep Transfer Learning	2025	SIGMOD	4.1945683e-05
9,264	Model-Parallel Model Selection for Deep Learning Systems	2021	SIGMOD	4.3675421e-05
9,120	Deep Query Optimization	2019	SIGMOD	4.392741e-05
4,180	FastFlow: Accelerating Deep Learning Model Training with Smart Offloading of Input Data Pipeline	2023	VLDB	6.3793352e-05
13,171	Reimagining Deep Learning Systems Through the Lens of Data Systems	2024	VLDB	-