DBScholar

Back to papers

Computation Reuse in Analytics Job Service at Microsoft

Summary: CloudViews: computation reuse for Microsoft’s SCOPE analytics service. Online materialized views capture recurring workloads; a feedback loop uses compile-time/run-time stats to estimate utility vs. cost, enabling online, no-offline materialization. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
5551
Venue
SIGMOD
Year
2018
Pagerank
7.2640711e-05
Overall Rank
3,605 | 75.27%
DOI
10.1145/3183713.3190656

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{jindal_sigmod18,
        title = {{Computation Reuse in Analytics Job Service at Microsoft}},
        author = {Jindal, Alekh and Qiao, Shi and Patel, Hiren and Yin, Zhicheng and Di, Jieming and Bag, Malay and Friedman, Marc and Lin, Yifung and Karanasos, Konstantinos and Rao, Sriram},
        series = {{SIGMOD} '18},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3183713.3190656},
        url = {https://dl.acm.org/doi/10.1145/3183713.3190656},
        year = {2018}
}

Incoming Citations (Sorted by Pagerank)

Showing 30 of 30 citing papers.

Rank Citing Paper Year Venue Pagerank
1,061 Are We Ready For Learned Cardinality Estimation? 2021 VLDB 0.00012369764
1,468 Towards a Learning Optimizer for Shared Clouds 2019 VLDB 0.00010686496
1,765 Selecting Subexpressions to Materialize at Datacenter Scale 2018 VLDB 9.8079546e-05
2,822 Cost Models for Big Data Query Processing: Learning, Retrofitting, and Our Findings 2020 SIGMOD 8.0898536e-05
3,555 Apache Hive: From MapReduce to Enterprise-grade Big Data Warehousing 2019 SIGMOD 7.3115321e-05
3,964 Hyper Dimension Shuffle: Efficient Data Repartition at Petabyte Scale in SCOPE 2019 VLDB 6.9855158e-05
3,998 Deploying a Steered Query Optimizer in Production at Microsoft 2022 SIGMOD 6.9676473e-05
5,059 Steering Query Optimizers: A Practical Take on Big Data Workloads 2021 SIGMOD 6.3807509e-05
5,348 Crystal: A Unified Cache Storage System for Analytical Databases 2021 VLDB 6.2562688e-05
5,704 Optimizing Data Pipelines for Machine Learning in Feature Stores 2023 VLDB 6.1146371e-05
6,121 The Cosmos Big Data Platform at Microsoft: Over a Decade of Progress and a Decade to Look Forward 2021 VLDB 5.9688569e-05
6,462 PilotScope: Steering Databases with Machine Learning Drivers 2024 VLDB 5.8717744e-05
6,684 CrocodileDB: Efficient Database Execution through Intelligent Deferment 2020 CIDR 5.8036476e-05
7,311 Lachesis: Automatic Partitioning for UDF-Centric Analytics 2021 VLDB 5.6491618e-05
7,580 Sibyl: Forecasting Time-Evolving Query Workloads 2024 SIGMOD 5.5925285e-05
7,619 AutoToken: Predicting Peak Parallelism for Big Data Analytics at Microsoft 2020 VLDB 5.5810604e-05
7,661 Machine Learning for Cloud Data Systems: the Progress so far and the Path Forward 2021 VLDB 5.5736026e-05
8,001 Pangea: Monolithic Distributed Storage for Data Analytics 2019 VLDB 5.508791e-05
8,175 SparkCruise: Workload Optimization in Managed Spark Clusters at Microsoft 2021 VLDB 5.4737932e-05
8,193 Towards Building Autonomous Data Services on Azure 2023 SIGMOD 5.4696038e-05
8,448 Towards Query Optimizer as a Service (QOaaS) in a Unified LakeHouse Ecosystem: Can One QO Rule Them All? 2025 CIDR 5.4235725e-05
8,527 View Selection over Knowledge Graphs in Triple Stores 2021 VLDB 5.4119882e-05
8,798 GEqO: ML-Accelerated Semantic Equivalence Detection 2023 SIGMOD 5.3698781e-05
8,927 Hyperspace: The Indexing Subsystem of Azure Synapse 2021 VLDB 5.3483178e-05
9,224 Phoebe: A Learning-based Checkpoint Optimizer 2021 VLDB 5.3035811e-05
9,456 QURE: AI-Assisted and Automatically Verified UDF Inlining 2025 SIGMOD 5.2643416e-05
9,529 Hippo: Sharing Computations in Hyper-Parameter Optimization 2022 VLDB 5.2545475e-05
9,854 SparkCruise: Handsfree Computation Reuse in Spark 2019 VLDB 5.2091816e-05
9,951 Cquirrel: Continuous Query Processing over Acyclic Relational Schemas 2021 VLDB 5.1915905e-05
13,399 PikePlace: Generating Intelligence for Marketplace Datasets 2023 VLDB -
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 26 of 26 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
11 Implementing Data Cubes Efficiently 1996 SIGMOD 0.00071822821
18 How Good Are Query Optimizers, Really? 2016 VLDB 0.00059284255
30 SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets 2008 VLDB 0.00051174276
32 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB 0.00050111008
87 Automated Selection of Materialized Views and Indexes for SQL Databases 2000 VLDB 0.00035281619
100 LEO - DB2's LEarning Optimizer 2001 VLDB 0.00034385207
128 Efficient and Extensible Algorithms for Multi Query Optimization 2000 SIGMOD 0.0003072825
151 Efficient Mid-Query Re-Optimization of Sub-Optimal Query Execution Plans 1998 SIGMOD 0.00029161879
492 Robust Query Processing through Progressive Optimization 2004 SIGMOD 0.0001756877
514 Goods: Organizing Google's Datasets 2016 SIGMOD 0.00017178673
696 Main-Memory Scan Sharing For Multi-Core CPUs 2008 VLDB 0.00014891322
761 Cooperative Scans: Dynamic Bandwidth Sharing in a DBMS 2007 VLDB 0.00014254351
803 MRShare: Sharing Across Multiple Queries in MapReduce 2010 VLDB 0.00013899943
829 Proactive Re-Optimization 2005 SIGMOD 0.00013769838
1,154 Efficient Exploitation of Similar Subexpressions for Query Processing 2007 SIGMOD 0.00011934202
1,543 Data Warehouse Configuration 1997 VLDB 0.00010413384
1,883 ReStore: Reusing Results of MapReduce Jobs 2012 VLDB 9.5421713e-05
2,151 An Architecture for Recycling Intermediates in a Column-store 2009 SIGMOD 9.0784444e-05
2,276 Shared Workload Optimization 2014 VLDB 8.8196376e-05
3,163 Multi-Query Optimization in MapReduce Framework 2014 VLDB 7.6784171e-05
4,481 Dynamically Optimizing Queries over Large Scale Data Platforms 2014 SIGMOD 6.6754521e-05
4,639 MQJoin: Efficient Shared Execution of Main-Memory Joins 2016 VLDB 6.5918791e-05
4,742 Continuous Cloud-Scale Query Optimization and Processing 2013 VLDB 6.5269203e-05
7,238 Kodiak: Leveraging Materialized Views For Very Low-Latency Analytics Over High-Dimensional Web-Scale Data 2016 VLDB 5.664642e-05
7,673 ROBUS: Fair Cache Allocation for Data-parallel Workloads 2017 SIGMOD 5.5705944e-05
7,878 Dependency-Driven Analytics: a Compass for Uncharted Data Oceans 2017 CIDR 5.5246167e-05
Previous Page 1 / 1 Next

Semantically Similar Papers