Towards instance-optimized data systems

Summary: ML-driven, instance-optimized data systems that self-tune to workload and data distribution. Progress report from MIT-DSAIL on ML for Systems, assessing readiness and deployment, with focus on optimization, indexing, storage layouts, scheduling, sorting, compression, and sketches. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 12533
Venue: VLDB
Year: 2021
Pagerank: 5.1227886e-05
Overall Rank: 6,297 | 56.20%
DOI: 10.14778/3476311.3476392

Incoming Non-self Citations Over Time

Authors

1. Tim Kraska

Incoming Citations (Sorted by Pagerank)

Showing 7 of 7 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
2,320	High-Throughput Vector Similarity Search in Knowledge Graphs	2023	SIGMOD	9.0366225e-05
4,690	Deploying a Steered Query Optimizer in Production at Microsoft	2022	SIGMOD	5.997226e-05
5,671	LSched: A Workload-Aware Learned Query Scheduler for Analytical Database Systems	2022	SIGMOD	5.3803919e-05
8,417	The Case for Learned In-Memory Joins	2023	VLDB	4.5194164e-05
9,346	Can Learned Indexes be Built Efficiently? A Deep Dive into Sampling Trade-offs	2024	SIGMOD	4.3532026e-05
9,806	The Image Calculator: 10x Faster Image-AI Inference by Replacing JPEG with Self-designing Storage Format	2024	SIGMOD	4.2805224e-05
9,827	PLATON: Top-down R-tree Packing with Learned Partition Policy	2023	SIGMOD	4.2751057e-05

Outgoing Citations (Sorted by Pagerank)

Showing 50 of 51 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
7	Optimal Aggregation Algorithms for Middleware [Extended Abstract]	2001	PODS	0.0015496097
102	The Case for Learned Index Structures	2018	SIGMOD	0.00049545203
158	Automated Selection of Materialized Views and Indexes for SQL Databases	2000	VLDB	0.00040071492
182	LEO - DB2's LEarning Optimizer	2001	VLDB	0.00036962631
183	Automatic Database Management System Tuning Through Large-scale Machine Learning	2017	SIGMOD	0.00036721403
185	DuckDB: an Embeddable Analytical Database	2019	SIGMOD	0.00036538405
204	Learned Cardinalities: Estimating Correlated Joins with Deep Learning	2019	CIDR	0.00034784455
209	Schism: a Workload-Driven Approach to Database Replication and Partitioning	2010	VLDB	0.00034468292
237	An Efficient, Cost-Driven Index Selection Tool for Microsoft SQL Server	1997	VLDB	0.00031726304
285	Automating Physical Database Design in a Parallel Database	2002	SIGMOD	0.0002899128
286	Integrating Vertical and Horizontal Partitioning into Automated Physical Database Design	2004	SIGMOD	0.00028990057
333	Neo: A Learned Query Optimizer	2019	VLDB	0.00027206884
359	Self-Driving Database Management Systems	2017	CIDR	0.0002592783
424	Tuning Database Configuration Parameters with iTuned	2009	VLDB	0.00023616398
516	AutoAdmin "What-if" Index Analysis Utility	1998	SIGMOD	0.00021196031
640	Bao: Making Learned Query Optimization Practical	2021	SIGMOD	0.00018759152
720	Building a Database on S3	2008	SIGMOD	0.00017615431
758	Deep Unsupervised Cardinality Estimation	2020	VLDB	0.0001706608
765	Automatic Performance Diagnosis and Tuning in Oracle	2005	CIDR	0.00017016449
782	QTune: A Query-Aware Database Tuning System with Deep Reinforcement Learning	2019	VLDB	0.00016729063
801	SageDB: A Learned Database System	2019	CIDR	0.00016505496
806	An End-to-End Learning-based Cost Estimator	2020	VLDB	0.00016434274
826	ALEX: An Updatable Adaptive Learned Index	2020	SIGMOD	0.00016224841
857	The PGM-index: a fully-dynamic compressed learned index with provable worst-case bounds	2020	VLDB	0.00015882892
910	NeuroCard: One Cardinality Estimator for All Tables	2021	VLDB	0.00015423056
1,088	ARIES/IM: An Efficient and High Concurrency Index Management Method Using Write-Ahead Logging	1992	SIGMOD	0.00014161003
1,375	FITing-Tree: A Data-aware Index Structure	2019	SIGMOD	0.00012303141
1,460	Benchmarking Learned Indexes	2021	VLDB	0.00011887068
1,478	Learning Multi-dimensional Indexes	2020	SIGMOD	0.00011762542
1,611	Qd-tree: Learning Data Layouts for Big Data Analytics	2020	SIGMOD	0.00011147324
1,737	QuickSel: Quick Selectivity Learning with Mixture Models	2020	SIGMOD	0.00010720294
1,827	An Inquiry into Machine Learning-based Automatic Configuration Tuning Services on Real-World Database Management Systems	2021	VLDB	0.00010390548
1,855	AI Meets AI: Leveraging Query Executions to Improve Index Recommendations	2019	SIGMOD	0.00010315245
1,889	Tsunami: A Learned Multi-dimensional Index for Correlated Data and Skewed Workloads	2021	VLDB	0.00010200865
1,902	Black or White? How to Develop an AutoTuner for Memory-based Analytics	2020	SIGMOD	0.00010157713
2,307	On Predictive Modeling for Optimizing Transaction Execution in Parallel OLTP Systems	2012	VLDB	9.0599752e-05
2,552	Updatable Learned Index with Precise Positions	2021	VLDB	8.5530411e-05
2,606	Design Continuums and the Path Toward Self-Designing Key-Value Stores that Know and Learn	2019	CIDR	8.4645832e-05
2,783	Flow-Loss: Learning Cardinality Estimates That Matter	2021	VLDB	8.1293383e-05
3,745	DeepSqueeze: Deep Semantic Compression for Tabular Data	2020	SIGMOD	6.7926132e-05
3,779	Instance-Optimized Data Layouts for Cloud Analytics Workloads	2021	SIGMOD	6.7747205e-05
4,060	CDFShop: Exploring and Optimizing Learned Index Structures	2020	SIGMOD	6.4836825e-05
4,084	APEX: A High-Performance Learned Index on Persistent Memory	2022	VLDB	6.4622113e-05
4,097	The Case for a Learned Sorting Algorithm	2020	SIGMOD	6.4551616e-05
4,446	Stable Learned Bloom Filters for Data Streams	2020	VLDB	6.1800659e-05
5,157	Hist-Tree: Those Who Ignore It Are Doomed to Learn	2021	CIDR	5.6589595e-05
5,258	One Model to Rule them All: Towards Zero-Shot Learning for Databases	2022	CIDR	5.5998705e-05
6,040	Steering Query Optimizers: A Practical Take on Big Data Workloads	2021	SIGMOD	5.2412035e-05
6,268	Speedup Your Analytics: Automatic Parameter Tuning for Databases and Big Data Systems	2019	VLDB	5.133857e-05
6,456	From Auto-tuning One Size Fits All to Self-designed and Learned Data-intensive Systems	2019	SIGMOD	5.0564619e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
13,513	Database Systems Research on Data Mining	2010	SIGMOD	-
8,346	Deep Learning: Systems and Responsibility	2021	SIGMOD	4.5420668e-05
6,191	Automatic Optimization of Matrix Implementations for Distributed Machine Learning and Linear Algebra	2021	SIGMOD	5.1642282e-05
1,532	Data Management in Machine Learning: Challenges, Techniques, and Systems	2017	SIGMOD	0.00011472681
10,843	Machine Learning for Graph Data Management and Query Processing	2025	VLDB	4.1945683e-05
4,906	Machine Learning for Big Data	2013	SIGMOD	5.8389053e-05
8,442	SageDB: An Instance-Optimized Data Analytics System	2022	VLDB	4.5120602e-05
5,861	Machine Learning for Databases	2021	VLDB	5.298883e-05
13,171	Reimagining Deep Learning Systems Through the Lens of Data Systems	2024	VLDB	-
6,456	From Auto-tuning One Size Fits All to Self-designed and Learned Data-intensive Systems	2019	SIGMOD	5.0564619e-05