Machine Learning for Cloud Data Systems: the Progress so far and the Path Forward

Summary: Tutorial surveying ML’s real-world adoption in cloud data systems versus its promise, then outlining enterprise hurdles: explainability, debugging, deployment and management, data constraints/anonymization, and accumulated model technical debt. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: 12717
Venue: VLDB
Year: 2021
Pagerank: 5.5736026e-05
Overall Rank: 7,661 | 47.44%
DOI: 10.14778/3476311.3476408

Incoming Non-self Citations Over Time

Authors

1. Alekh Jindal (Microsoft)
2. Matteo Interlandi (Microsoft)

BibTeX Citation

@article{jindal_vldb21,
        title = {{Machine Learning for Cloud Data Systems: the Progress so far and the Path Forward}},
        author = {Jindal, Alekh and Interlandi, Matteo},
        journal = {PVLDB},
        series = {{VLDB} '21},
        volume = {14},
        number = {12},
        pages = {3202--3205},
        doi = {10.14778/3476311.3476408},
        url = {https://doi.org/10.14778/3476311.3476408},
        year = {2021}
}

Incoming Citations (Sorted by Pagerank)

Showing 3 of 3 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
3,998	Deploying a Steered Query Optimizer in Production at Microsoft	2022	SIGMOD	6.9676473e-05
4,449	From BERT to GPT-3 Codex: Harnessing the Potential of Very Large Language Models for Data Management	2022	VLDB	6.697553e-05
11,607	Machine Programming: Turning Data into Programmer Productivity	2022	VLDB	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 22 of 22 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
43	The Case for Learned Index Structures	2018	SIGMOD	0.00046060254
154	Neo: A Learned Query Optimizer	2019	VLDB	0.00028726181
682	Robust Estimation of Resource Consumption for SQL Queries using Statistical Techniques	2012	VLDB	0.00015014887
697	Selectivity Estimation for Range Predicates using Lightweight Models	2019	VLDB	0.00014888851
1,061	Are We Ready For Learned Cardinality Estimation?	2021	VLDB	0.00012369764
1,224	Dhalion: Self-Regulating Stream Processing in Heron	2017	VLDB	0.00011596911
1,279	AI Meets AI: Leveraging Query Executions to Improve Index Recommendations	2019	SIGMOD	0.00011361878
1,468	Towards a Learning Optimizer for Shared Clouds	2019	VLDB	0.00010686496
1,876	Flow-Loss: Learning Cardinality Estimates That Matter	2021	VLDB	9.5717543e-05
2,822	Cost Models for Big Data Query Processing: Learning, Retrofitting, and Our Findings	2020	SIGMOD	8.0898536e-05
3,460	DIAMetrics: Benchmarking Query Engines at Scale	2020	VLDB	7.3939262e-05
3,605	Computation Reuse in Analytics Job Service at Microsoft	2018	SIGMOD	7.2640711e-05
3,853	Understanding and Benchmarking the Impact of GDPR on Database Systems	2020	VLDB	7.0733274e-05
3,960	HedgeCut: Maintaining Randomised Trees for Low-Latency Machine Unlearning	2021	SIGMOD	6.9878154e-05
5,059	Steering Query Optimizers: A Practical Take on Big Data Workloads	2021	SIGMOD	6.3807509e-05
6,781	Seagull: An Infrastructure for Load Prediction and Optimized Resource Allocation	2021	VLDB	5.7764885e-05
6,946	KEA: Tuning an Exabyte-Scale Data Infrastructure	2021	SIGMOD	5.7309848e-05
7,619	AutoToken: Predicting Peak Parallelism for Big Data Analytics at Microsoft	2020	VLDB	5.5810604e-05
8,040	PerfGuard: Deploying ML-for-Systems without Performance Regressions, Almost!	2021	VLDB	5.5018396e-05
8,309	Spur: Mitigating Slow Instances in Large-Scale Streaming Pipelines	2020	SIGMOD	5.4560857e-05
9,224	Phoebe: A Learning-based Checkpoint Optimizer	2021	VLDB	5.3035811e-05
9,854	SparkCruise: Handsfree Computation Reuse in Spark	2019	VLDB	5.2091816e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	13,470	From ML Models to Intelligent Applications: The Rise of MLOps	2021	VLDB
2	8,193	Towards Building Autonomous Data Services on Azure	2023	SIGMOD
3	6,315	Data Collection and Quality Challenges for Deep Learning	2020	VLDB
4	3,614	Cloudy with High Chance of DBMS: A 10-year Prediction for Enterprise-Grade ML	2020	CIDR
5	13,480	Systems and ML: When the Sum is Greater than Its Parts	2020	SIGMOD
6	8,328	Deep Learning: Systems and Responsibility	2021	SIGMOD
7	13,549	Machine Learning in the Real World	2016	VLDB
8	1,147	Data Management Challenges in Production Machine Learning	2017	SIGMOD
9	1,250	Data Management in Machine Learning: Challenges, Techniques, and Systems	2017	SIGMOD
10	4,859	Machine Learning for Big Data	2013	SIGMOD