DBScholar

Back to papers

Computation Reuse in Analytics Job Service at Microsoft

Summary: CloudViews: computation reuse for Microsoft’s SCOPE analytics service. Online materialized views capture recurring workloads; a feedback loop uses compile-time/run-time stats to estimate utility vs. cost, enabling online, no-offline materialization. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h4aa5f72852906856
Venue
SIGMOD
Year
2018
Pagerank
7.1895215e-05
Overall Rank
3,550 | 76.21%
DOI
10.1145/3183713.3190656

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{jindal_sigmod18,
        title = {{Computation Reuse in Analytics Job Service at Microsoft}},
        author = {Jindal, Alekh and Qiao, Shi and Patel, Hiren and Yin, Zhicheng and Di, Jieming and Bag, Malay and Friedman, Marc and Lin, Yifung and Karanasos, Konstantinos and Rao, Sriram},
        series = {{SIGMOD} '18},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3183713.3190656},
        url = {https://dl.acm.org/doi/10.1145/3183713.3190656},
        year = {2018}
}

Incoming Citations (Sorted by Pagerank)

Showing 31 of 31 citing papers.

Rank Citing Paper Year Venue Pagerank
1,064 Are We Ready For Learned Cardinality Estimation? 2021 VLDB 0.00012181459
1,436 Towards a Learning Optimizer for Shared Clouds 2019 VLDB 0.00010658836
1,757 Selecting Subexpressions to Materialize at Datacenter Scale 2018 VLDB 9.7050769e-05
2,828 Cost Models for Big Data Query Processing: Learning, Retrofitting, and Our Findings 2020 SIGMOD 7.9476509e-05
3,457 Apache Hive: From MapReduce to Enterprise-grade Big Data Warehousing 2019 SIGMOD 7.2667942e-05
3,907 Hyper Dimension Shuffle: Efficient Data Repartition at Petabyte Scale in SCOPE 2019 VLDB 6.9139522e-05
3,951 Deploying a Steered Query Optimizer in Production at Microsoft 2022 SIGMOD 6.8884038e-05
5,126 Steering Query Optimizers: A Practical Take on Big Data Workloads 2021 SIGMOD 6.2493606e-05
5,210 Crystal: A Unified Cache Storage System for Analytical Databases 2021 VLDB 6.2142008e-05
5,713 PilotScope: Steering Databases with Machine Learning Drivers 2024 VLDB 6.0090633e-05
5,793 Optimizing Data Pipelines for Machine Learning in Feature Stores 2023 VLDB 5.9761004e-05
6,260 The Cosmos Big Data Platform at Microsoft: Over a Decade of Progress and a Decade to Look Forward 2021 VLDB 5.815273e-05
6,590 Towards Query Optimizer as a Service (QOaaS) in a Unified LakeHouse Ecosystem: Can One QO Rule Them All? 2025 CIDR 5.7233093e-05
6,835 CrocodileDB: Efficient Database Execution through Intelligent Deferment 2020 CIDR 5.6527238e-05
7,162 Sibyl: Forecasting Time-Evolving Query Workloads 2024 SIGMOD 5.5798063e-05
7,405 Lachesis: Automatic Partitioning for UDF-Centric Analytics 2021 VLDB 5.5172664e-05
7,764 AutoToken: Predicting Peak Parallelism for Big Data Analytics at Microsoft 2020 VLDB 5.4403231e-05
7,830 Machine Learning for Cloud Data Systems: the Progress so far and the Path Forward 2021 VLDB 5.4294933e-05
8,191 Pangea: Monolithic Distributed Storage for Data Analytics 2019 VLDB 5.3648409e-05
8,362 SparkCruise: Workload Optimization in Managed Spark Clusters at Microsoft 2021 VLDB 5.3308358e-05
8,372 Towards Building Autonomous Data Services on Azure 2023 SIGMOD 5.3287108e-05
8,724 View Selection over Knowledge Graphs in Triple Stores 2021 VLDB 5.2705676e-05
8,992 GEqO: ML-Accelerated Semantic Equivalence Detection 2023 SIGMOD 5.2295579e-05
9,117 Hyperspace: The Indexing Subsystem of Azure Synapse 2021 VLDB 5.208561e-05
9,394 Phoebe: A Learning-based Checkpoint Optimizer 2021 VLDB 5.1676892e-05
9,672 QURE: AI-Assisted and Automatically Verified UDF Inlining 2025 SIGMOD 5.1267792e-05
9,746 Hippo: Sharing Computations in Hyper-Parameter Optimization 2022 VLDB 5.1178001e-05
10,034 SparkCruise: Handsfree Computation Reuse in Spark 2019 VLDB 5.0795508e-05
10,175 Cquirrel: Continuous Query Processing over Acyclic Relational Schemas 2021 VLDB 5.0559291e-05
10,966 Benchmarking the Full Pipeline of Materialized-View-Based Query Rewriting 2026 VLDB 4.9605343e-05
13,758 PikePlace: Generating Intelligence for Marketplace Datasets 2023 VLDB -
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 26 of 26 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
11 Implementing Data Cubes Efficiently 1996 SIGMOD 0.00070860346
15 How Good Are Query Optimizers, Really? 2016 VLDB 0.00061463175
30 SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets 2008 VLDB 0.00050364918
31 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB 0.00049707539
89 Automated Selection of Materialized Views and Indexes for SQL Databases 2000 VLDB 0.00035265687
98 LEO - DB2's LEarning Optimizer 2001 VLDB 0.00034050614
129 Efficient and Extensible Algorithms for Multi Query Optimization 2000 SIGMOD 0.00030314403
149 Efficient Mid-Query Re-Optimization of Sub-Optimal Query Execution Plans 1998 SIGMOD 0.00028910892
471 Robust Query Processing through Progressive Optimization 2004 SIGMOD 0.00017691682
512 Goods: Organizing Google's Datasets 2016 SIGMOD 0.00017036842
707 Main-Memory Scan Sharing For Multi-Core CPUs 2008 VLDB 0.00014613324
768 Cooperative Scans: Dynamic Bandwidth Sharing in a DBMS 2007 VLDB 0.00014096379
825 MRShare: Sharing Across Multiple Queries in MapReduce 2010 VLDB 0.00013600553
838 Proactive Re-Optimization 2005 SIGMOD 0.00013528646
1,137 Efficient Exploitation of Similar Subexpressions for Query Processing 2007 SIGMOD 0.00011856159
1,550 Data Warehouse Configuration 1997 VLDB 0.00010257652
1,936 ReStore: Reusing Results of MapReduce Jobs 2012 VLDB 9.3375824e-05
2,092 An Architecture for Recycling Intermediates in a Column-store 2009 SIGMOD 9.0432353e-05
2,237 Shared Workload Optimization 2014 VLDB 8.7777395e-05
3,228 Multi-Query Optimization in MapReduce Framework 2014 VLDB 7.4957341e-05
4,088 Dynamically Optimizing Queries over Large Scale Data Platforms 2014 SIGMOD 6.7973616e-05
4,751 MQJoin: Efficient Shared Execution of Main-Memory Joins 2016 VLDB 6.42279e-05
4,842 Continuous Cloud-Scale Query Optimization and Processing 2013 VLDB 6.3734445e-05
5,113 ROBUS: Fair Cache Allocation for Data-parallel Workloads 2017 SIGMOD 6.2569879e-05
7,366 Kodiak: Leveraging Materialized Views For Very Low-Latency Analytics Over High-Dimensional Web-Scale Data 2016 VLDB 5.5268158e-05
8,048 Dependency-Driven Analytics: a Compass for Uncharted Data Oceans 2017 CIDR 5.3842397e-05
Previous Page 1 / 1 Next

Semantically Similar Papers