Intelligent Pooling: Proactive Resource Provisioning in Large-scale Cloud Service
Summary: Intelligent Pooling proactively provisions Spark resources using a low-latency hybrid ML model that predicts demand and dynamically tunes pool sizes. Production deployment cuts idle time 43% versus static pooling at 99% hit rate, reducing cloud COGS. (summarized by gpt-5.6-luna on Jul 24 2026)
Incoming Non-self Citations Over Time
No non-self incoming citations found for this paper in this database.
Authors
- 1. Deepak Ravikumar (Purdue University)
- 2. Alex Yeo (Netflix)
- 3. Yiwen Zhu (Microsoft)
- 4. Aditya Lakra (Microsoft)
- 5. Harsha Nagulapalli (Microsoft)
- 6. Santhosh Ravindran (Microsoft)
- 7. Steve Suh (Microsoft)
- 8. Niharika Dutta (Microsoft)
- 9. Andrew Fogarty (Microsoft)
- 10. Yoonjae Park (Microsoft)
- 11. Sumeet Khushalani (Microsoft)
- 12. Arijit Tarafdar (Microsoft)
- 13. Kunal Parekh (Microsoft)
- 14. Subru Krishnan (Microsoft)
BibTeX Citation
@article{ravikumar_vldb24,
title = {{Intelligent Pooling: Proactive Resource Provisioning in Large-scale Cloud Service}},
author = {Ravikumar, Deepak and Yeo, Alex and Zhu, Yiwen and Lakra, Aditya and Nagulapalli, Harsha and Ravindran, Santhosh and Suh, Steve and Dutta, Niharika and Fogarty, Andrew and Park, Yoonjae and Khushalani, Sumeet and Tarafdar, Arijit and Parekh, Kunal and Krishnan, Subru},
journal = {PVLDB},
series = {{VLDB} '24},
volume = {17},
number = {7},
pages = {1618--1627},
doi = {10.14778/3654621.3654629},
url = {https://doi.org/10.14778/3654621.3654629},
year = {2024}
}Incoming Citations (Sorted by Pagerank)
Showing 0 of 0 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 4 of 4 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 1,224 | Dhalion: Self-Regulating Stream Processing in Heron | 2017 | VLDB | 0.00011596911 |
| 2,226 | Moneyball: Proactive Auto-Scaling in Microsoft Azure SQL Database Serverless | 2022 | VLDB | 8.9174082e-05 |
| 6,781 | Seagull: An Infrastructure for Load Prediction and Optimized Resource Allocation | 2021 | VLDB | 5.7764885e-05 |
| 6,946 | KEA: Tuning an Exabyte-Scale Data Infrastructure | 2021 | SIGMOD | 5.7309848e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 5,083 | Automating Distributed Tiered Storage Management in Cluster Computing | 2020 | VLDB |
| 2 | 9,640 | Supporting Scalable Analytics with Latency Constraints | 2015 | VLDB |
| 3 | 7,589 | Cost-Intelligent Data Analytics in the Cloud | 2024 | CIDR |
| 4 | 4,049 | Resource Elasticity for Large-Scale Machine Learning | 2015 | SIGMOD |
| 5 | 8,175 | SparkCruise: Workload Optimization in Managed Spark Clusters at Microsoft | 2021 | VLDB |
| 6 | 6,344 | Towards General and Efficient Online Tuning for Spark | 2023 | VLDB |
| 7 | 8,457 | Towards Resource Efficiency: Practical Insights into Large-Scale Spark Workloads at ByteDance | 2024 | VLDB |
| 8 | 8,615 | A Spark Optimizer for Adaptive, Fine-Grained Parameter Tuning | 2024 | VLDB |
| 9 | 4,987 | Releasing Cloud Databases from the Chains of Performance Prediction Models | 2017 | CIDR |
| 10 | 6,102 | AutoExecutor: Predictive Parallelism for Spark SQL Queries | 2021 | VLDB |