DBScholar

Back to papers

Computation Reuse in Analytics Job Service at Microsoft

Summary: CloudViews: computation reuse for Microsoft’s SCOPE analytics service. Online materialized views capture recurring workloads; a feedback loop uses compile-time/run-time stats to estimate utility vs. cost, enabling online, no-offline materialization. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h4aa5f72852906856
Venue
SIGMOD
Year
2018
Pagerank
7.2134803e-05
Overall Rank
3,545 | 76.17%
DOI
10.1145/3183713.3190656

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{jindal_sigmod18,
        title = {{Computation Reuse in Analytics Job Service at Microsoft}},
        author = {Jindal, Alekh and Qiao, Shi and Patel, Hiren and Yin, Zhicheng and Di, Jieming and Bag, Malay and Friedman, Marc and Lin, Yifung and Karanasos, Konstantinos and Rao, Sriram},
        series = {{SIGMOD} '18},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3183713.3190656},
        url = {https://dl.acm.org/doi/10.1145/3183713.3190656},
        year = {2018}
}

Incoming Citations (Sorted by Pagerank)

Showing 31 of 31 citing papers.

Rank Citing Paper Year Venue Pagerank
1,064 Are We Ready For Learned Cardinality Estimation? 2021 VLDB 0.00012202282
1,433 Towards a Learning Optimizer for Shared Clouds 2019 VLDB 0.00010677711
1,745 Selecting Subexpressions to Materialize at Datacenter Scale 2018 VLDB 9.7343818e-05
2,834 Cost Models for Big Data Query Processing: Learning, Retrofitting, and Our Findings 2020 SIGMOD 7.9560627e-05
3,446 Apache Hive: From MapReduce to Enterprise-grade Big Data Warehousing 2019 SIGMOD 7.2942885e-05
3,895 Hyper Dimension Shuffle: Efficient Data Repartition at Petabyte Scale in SCOPE 2019 VLDB 6.9393157e-05
3,949 Deploying a Steered Query Optimizer in Production at Microsoft 2022 SIGMOD 6.9052796e-05
5,110 Steering Query Optimizers: A Practical Take on Big Data Workloads 2021 SIGMOD 6.269351e-05
5,446 Crystal: A Unified Cache Storage System for Analytical Databases 2021 VLDB 6.1266228e-05
5,773 Optimizing Data Pipelines for Machine Learning in Feature Stores 2023 VLDB 5.9987664e-05
5,871 PilotScope: Steering Databases with Machine Learning Drivers 2024 VLDB 5.9639223e-05
6,245 The Cosmos Big Data Platform at Microsoft: Over a Decade of Progress and a Decade to Look Forward 2021 VLDB 5.837329e-05
6,576 Towards Query Optimizer as a Service (QOaaS) in a Unified LakeHouse Ecosystem: Can One QO Rule Them All? 2025 CIDR 5.7448779e-05
6,814 CrocodileDB: Efficient Database Execution through Intelligent Deferment 2020 CIDR 5.6735614e-05
7,157 Sibyl: Forecasting Time-Evolving Query Workloads 2024 SIGMOD 5.5972283e-05
7,386 Lachesis: Automatic Partitioning for UDF-Centric Analytics 2021 VLDB 5.538189e-05
7,759 AutoToken: Predicting Peak Parallelism for Big Data Analytics at Microsoft 2020 VLDB 5.4575614e-05
7,806 Machine Learning for Cloud Data Systems: the Progress so far and the Path Forward 2021 VLDB 5.4500623e-05
8,165 Pangea: Monolithic Distributed Storage for Data Analytics 2019 VLDB 5.3851885e-05
8,346 SparkCruise: Workload Optimization in Managed Spark Clusters at Microsoft 2021 VLDB 5.3510511e-05
8,352 Towards Building Autonomous Data Services on Azure 2023 SIGMOD 5.3488341e-05
8,696 View Selection over Knowledge Graphs in Triple Stores 2021 VLDB 5.2905577e-05
8,962 GEqO: ML-Accelerated Semantic Equivalence Detection 2023 SIGMOD 5.2493925e-05
9,088 Hyperspace: The Indexing Subsystem of Azure Synapse 2021 VLDB 5.2283159e-05
9,358 Phoebe: A Learning-based Checkpoint Optimizer 2021 VLDB 5.1869771e-05
9,637 QURE: AI-Assisted and Automatically Verified UDF Inlining 2025 SIGMOD 5.1462239e-05
9,709 Hippo: Sharing Computations in Hyper-Parameter Optimization 2022 VLDB 5.1372107e-05
9,993 SparkCruise: Handsfree Computation Reuse in Spark 2019 VLDB 5.0988164e-05
10,134 Cquirrel: Continuous Query Processing over Acyclic Relational Schemas 2021 VLDB 5.0751052e-05
10,896 Benchmarking the Full Pipeline of Materialized-View-Based Query Rewriting 2026 VLDB 4.9793485e-05
13,713 PikePlace: Generating Intelligence for Marketplace Datasets 2023 VLDB -
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 26 of 26 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
11 Implementing Data Cubes Efficiently 1996 SIGMOD 0.00071084324
15 How Good Are Query Optimizers, Really? 2016 VLDB 0.00061066921
30 SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets 2008 VLDB 0.00050495102
31 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB 0.00049839909
88 Automated Selection of Materialized Views and Indexes for SQL Databases 2000 VLDB 0.00035351639
98 LEO - DB2's LEarning Optimizer 2001 VLDB 0.00034106982
129 Efficient and Extensible Algorithms for Multi Query Optimization 2000 SIGMOD 0.0003040756
149 Efficient Mid-Query Re-Optimization of Sub-Optimal Query Execution Plans 1998 SIGMOD 0.00028981723
481 Robust Query Processing through Progressive Optimization 2004 SIGMOD 0.00017603972
509 Goods: Organizing Google's Datasets 2016 SIGMOD 0.00017071087
705 Main-Memory Scan Sharing For Multi-Core CPUs 2008 VLDB 0.00014657491
762 Cooperative Scans: Dynamic Bandwidth Sharing in a DBMS 2007 VLDB 0.00014140446
823 MRShare: Sharing Across Multiple Queries in MapReduce 2010 VLDB 0.00013648332
836 Proactive Re-Optimization 2005 SIGMOD 0.00013557047
1,131 Efficient Exploitation of Similar Subexpressions for Query Processing 2007 SIGMOD 0.0001189909
1,547 Data Warehouse Configuration 1997 VLDB 0.00010292395
1,924 ReStore: Reusing Results of MapReduce Jobs 2012 VLDB 9.3687009e-05
2,084 An Architecture for Recycling Intermediates in a Column-store 2009 SIGMOD 9.0716512e-05
2,225 Shared Workload Optimization 2014 VLDB 8.8081001e-05
3,216 Multi-Query Optimization in MapReduce Framework 2014 VLDB 7.5234702e-05
4,069 Dynamically Optimizing Queries over Large Scale Data Platforms 2014 SIGMOD 6.821366e-05
4,730 MQJoin: Efficient Shared Execution of Main-Memory Joins 2016 VLDB 6.4468007e-05
4,818 Continuous Cloud-Scale Query Optimization and Processing 2013 VLDB 6.3964573e-05
5,088 ROBUS: Fair Cache Allocation for Data-parallel Workloads 2017 SIGMOD 6.2805079e-05
7,360 Kodiak: Leveraging Materialized Views For Very Low-Latency Analytics Over High-Dimensional Web-Scale Data 2016 VLDB 5.5427171e-05
8,027 Dependency-Driven Analytics: a Compass for Uncharted Data Oceans 2017 CIDR 5.4043169e-05
Previous Page 1 / 1 Next

Semantically Similar Papers