Machine Learning for Cloud Data Systems: the Progress so far and the Path Forward

Summary: Tutorial surveying ML’s real-world adoption in cloud data systems versus its promise, then outlining enterprise hurdles: explainability, debugging, deployment and management, data constraints/anonymization, and accumulated model technical debt. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: hfee57080101766b3
Venue: VLDB
Year: 2021
Pagerank: 5.4474823e-05
Overall Rank: 7,813 | 47.49%
DOI: 10.14778/3476311.3476408
PDF: Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

1. Alekh Jindal (Microsoft)
2. Matteo Interlandi (Microsoft)

BibTeX Citation

@article{jindal_vldb21,
        title = {{Machine Learning for Cloud Data Systems: the Progress so far and the Path Forward}},
        author = {Jindal, Alekh and Interlandi, Matteo},
        journal = {PVLDB},
        series = {{VLDB} '21},
        volume = {14},
        number = {12},
        pages = {3202--3205},
        doi = {10.14778/3476311.3476408},
        url = {https://doi.org/10.14778/3476311.3476408},
        year = {2021}
}

Incoming Citations (Sorted by Pagerank)

Showing 3 of 3 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
3,948	Deploying a Steered Query Optimizer in Production at Microsoft	2022	SIGMOD	6.9051584e-05
4,444	From BERT to GPT-3 Codex: Harnessing the Potential of Very Large Language Models for Data Management	2022	VLDB	6.5957098e-05
11,921	Machine Programming: Turning Data into Programmer Productivity	2022	VLDB	4.9769913e-05

Outgoing Citations (Sorted by Pagerank)

Showing 22 of 22 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
40	The Case for Learned Index Structures	2018	SIGMOD	0.00046363107
144	Neo: A Learned Query Optimizer	2019	VLDB	0.00029090793
682	Robust Estimation of Resource Consumption for SQL Queries using Statistical Techniques	2012	VLDB	0.00014814858
691	Selectivity Estimation for Range Predicates using Lightweight Models	2019	VLDB	0.00014737455
1,065	Are We Ready For Learned Cardinality Estimation?	2021	VLDB	0.00012202293
1,236	Dhalion: Self-Regulating Stream Processing in Heron	2017	VLDB	0.00011400483
1,280	AI Meets AI: Leveraging Query Executions to Improve Index Recommendations	2019	SIGMOD	0.00011224914
1,432	Towards a Learning Optimizer for Shared Clouds	2019	VLDB	0.00010676754
1,735	Flow-Loss: Learning Cardinality Estimates That Matter	2021	VLDB	9.7566604e-05
2,833	Cost Models for Big Data Query Processing: Learning, Retrofitting, and Our Findings	2020	SIGMOD	7.9539771e-05
3,462	DIAMetrics: Benchmarking Query Engines at Scale	2020	VLDB	7.280037e-05
3,544	Computation Reuse in Analytics Job Service at Microsoft	2018	SIGMOD	7.2108612e-05
3,938	Understanding and Benchmarking the Impact of GDPR on Database Systems	2020	VLDB	6.9125342e-05
4,039	HedgeCut: Maintaining Randomised Trees for Low-Latency Machine Unlearning	2021	SIGMOD	6.835801e-05
5,110	Steering Query Optimizers: A Practical Take on Big Data Workloads	2021	SIGMOD	6.2678118e-05
6,903	Seagull: An Infrastructure for Load Prediction and Optimized Resource Allocation	2021	VLDB	5.6493582e-05
7,086	KEA: Tuning an Exabyte-Scale Data Infrastructure	2021	SIGMOD	5.6002958e-05
7,356	PerfGuard: Deploying ML-for-Systems without Performance Regressions, Almost!	2021	VLDB	5.5421826e-05
7,767	AutoToken: Predicting Peak Parallelism for Big Data Analytics at Microsoft	2020	VLDB	5.4550466e-05
8,410	Spur: Mitigating Slow Instances in Large-Scale Streaming Pipelines	2020	SIGMOD	5.3360542e-05
9,367	Phoebe: A Learning-based Checkpoint Optimizer	2021	VLDB	5.1845217e-05
9,999	SparkCruise: Handsfree Computation Reuse in Spark	2019	VLDB	5.0964027e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	13,789	From ML Models to Intelligent Applications: The Rise of MLOps	2021	VLDB
2	8,357	Towards Building Autonomous Data Services on Azure	2023	SIGMOD
3	5,074	Data Collection and Quality Challenges for Deep Learning	2020	VLDB
4	3,685	Cloudy with High Chance of DBMS: A 10-year Prediction for Enterprise-Grade ML	2020	CIDR
5	13,799	Systems and ML: When the Sum is Greater than Its Parts	2020	SIGMOD
6	8,487	Deep Learning: Systems and Responsibility	2021	SIGMOD
7	13,867	Machine Learning in the Real World	2016	VLDB
8	1,153	Data Management Challenges in Production Machine Learning	2017	SIGMOD
9	1,223	Data Management in Machine Learning: Challenges, Techniques, and Systems	2017	SIGMOD
10	4,935	Machine Learning for Big Data	2013	SIGMOD