SparkCruise: Handsfree Computation Reuse in Spark
Summary: SparkCruise automatically identifies and materializes high-value common subcomputations from query history during Spark execution. It enables transparent, hands-free reuse—without code changes—supporting workload insights and pay-as-you-go materialization. (summarized by gpt-5.6-luna on Jul 24 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Abhishek Roy (Microsoft)
- 2. Alekh Jindal (Microsoft)
- 3. Hiren Patel (Microsoft)
- 4. Ashit Gosalia (Microsoft)
- 5. Subru Krishnan (Microsoft)
- 6. Carlo Curino (Microsoft)
BibTeX Citation
@article{roy_vldb19,
title = {{SparkCruise: Handsfree Computation Reuse in Spark}},
author = {Roy, Abhishek and Jindal, Alekh and Patel, Hiren and Gosalia, Ashit and Krishnan, Subru and Curino, Carlo},
journal = {PVLDB},
series = {{VLDB} '19},
volume = {12},
number = {12},
pages = {1850--1853},
doi = {10.14778/3352063.3352082},
url = {https://doi.org/10.14778/3352063.3352082},
year = {2019}
}Incoming Citations (Sorted by Pagerank)
Showing 5 of 5 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 2,822 | Cost Models for Big Data Query Processing: Learning, Retrofitting, and Our Findings | 2020 | SIGMOD | 8.0898536e-05 |
| 7,619 | AutoToken: Predicting Peak Parallelism for Big Data Analytics at Microsoft | 2020 | VLDB | 5.5810604e-05 |
| 7,661 | Machine Learning for Cloud Data Systems: the Progress so far and the Path Forward | 2021 | VLDB | 5.5736026e-05 |
| 8,175 | SparkCruise: Workload Optimization in Managed Spark Clusters at Microsoft | 2021 | VLDB | 5.4737932e-05 |
| 9,145 | SIEVE: Effective Filtered Vector Search with Collection of Indexes | 2025 | VLDB | 5.3150984e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 2 of 2 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 1,765 | Selecting Subexpressions to Materialize at Datacenter Scale | 2018 | VLDB | 9.8079546e-05 |
| 3,605 | Computation Reuse in Analytics Job Service at Microsoft | 2018 | SIGMOD | 7.2640711e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 11,399 | QaaD (Query-as-a-Data): Scalable Execution of Massive Number of Small Queries in Spark | 2023 | SIGMOD |
| 2 | 9,655 | [Demo] Low-latency Spark Queries on Updatable Data | 2019 | SIGMOD |
| 3 | 6,865 | SparkR: Scaling R Programs with Spark | 2016 | SIGMOD |
| 4 | 8,615 | A Spark Optimizer for Adaptive, Fine-Grained Parameter Tuning | 2024 | VLDB |
| 5 | 6,850 | Bridging the Gap Between HPC and Big Data Frameworks | 2017 | VLDB |
| 6 | 2,594 | Big Data Analytics with Datalog Queries on Spark | 2016 | SIGMOD |
| 7 | 8,457 | Towards Resource Efficiency: Practical Insights into Large-Scale Spark Workloads at ByteDance | 2024 | VLDB |
| 8 | 3,605 | Computation Reuse in Analytics Job Service at Microsoft | 2018 | SIGMOD |
| 9 | 3,411 | Scaling Spark in the Real World: Performance and Usability | 2015 | VLDB |
| 10 | 8,175 | SparkCruise: Workload Optimization in Managed Spark Clusters at Microsoft | 2021 | VLDB |