Intelligent Pooling: Proactive Resource Provisioning in Large-scale Cloud Service
Summary: Proactive provisioning for Spark: hybrid low-latency ML predicts cluster/session demand and drives dynamic pool-size optimization to eliminate expensive startup overheads. Auto-tuned tradeoff between latency and COGS yields up to 43% idle-time reduction at 99% hit rate and is deployed in production. (summarized by gpt-5-mini on Feb 09 2026)
Incoming Non-self Citations Over Time
No non-self incoming citations found for this paper in this database.
Authors
- 1. Deepak Ravikumar
- 2. Alex Yeo
- 3. Yiwen Zhu
- 4. Aditya Lakra
- 5. Harsha Nagulapalli
- 6. Santhosh Ravindran
- 7. Steve Suh
- 8. Niharika Dutta
- 9. Andrew Fogarty
- 10. Yoonjae Park
- 11. Sumeet Khushalani
- 12. Arijit Tarafdar
- 13. Kunal Parekh
- 14. Subru Krishnan
Incoming Citations (Sorted by Pagerank)
Showing 0 of 0 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 4 of 4 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 1,084 | Dhalion: Self-Regulating Stream Processing in Heron | 2017 | VLDB | 0.00014209714 |
| 2,375 | Moneyball: Proactive Auto-Scaling in Microsoft Azure SQL Database Serverless | 2022 | VLDB | 8.9452359e-05 |
| 6,757 | KEA: Tuning an Exabyte-Scale Data Infrastructure | 2021 | SIGMOD | 4.9372134e-05 |
| 7,047 | Seagull: An Infrastructure for Load Prediction and Optimized Resource Allocation | 2021 | VLDB | 4.8521181e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| Overall Rank | Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 6,104 | Automating Distributed Tiered Storage Management in Cluster Computing | 2020 | VLDB | 5.2080102e-05 |
| 9,504 | Supporting Scalable Analytics with Latency Constraints | 2015 | VLDB | 4.3341665e-05 |
| 7,889 | Cost-Intelligent Data Analytics in the Cloud | 2024 | CIDR | 4.6253386e-05 |
| 4,802 | Resource Elasticity for Large-Scale Machine Learning | 2015 | SIGMOD | 5.9114415e-05 |
| 8,197 | SparkCruise: Workload Optimization in Managed Spark Clusters at Microsoft | 2021 | VLDB | 4.5607121e-05 |
| 6,871 | Towards General and Efficient Online Tuning for Spark | 2023 | VLDB | 4.8997004e-05 |
| 9,155 | Towards Resource Efficiency: Practical Insights into Large-Scale Spark Workloads at ByteDance | 2024 | VLDB | 4.3849295e-05 |
| 8,617 | A Spark Optimizer for Adaptive, Fine-Grained Parameter Tuning | 2024 | VLDB | 4.4846425e-05 |
| 4,961 | Releasing Cloud Databases from the Chains of Performance Prediction Models | 2017 | CIDR | 5.7984657e-05 |
| 6,209 | AutoExecutor: Predictive Parallelism for Spark SQL Queries | 2021 | VLDB | 5.1565972e-05 |