DBScholar

Back to papers

Computation Reuse in Analytics Job Service at Microsoft

Summary: CloudViews: computation reuse for Microsoft’s SCOPE analytics service. Online materialized views capture recurring workloads; a feedback loop uses compile-time/run-time stats to estimate utility vs. cost, enabling online, no-offline materialization. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h4aa5f72852906856
Venue
SIGMOD
Year
2018
Pagerank
7.2108612e-05
Overall Rank
3,544 | 76.19%
DOI
10.1145/3183713.3190656

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{jindal_sigmod18,
        title = {{Computation Reuse in Analytics Job Service at Microsoft}},
        author = {Jindal, Alekh and Qiao, Shi and Patel, Hiren and Yin, Zhicheng and Di, Jieming and Bag, Malay and Friedman, Marc and Lin, Yifung and Karanasos, Konstantinos and Rao, Sriram},
        series = {{SIGMOD} '18},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3183713.3190656},
        url = {https://dl.acm.org/doi/10.1145/3183713.3190656},
        year = {2018}
}

Incoming Citations (Sorted by Pagerank)

Showing 31 of 31 citing papers.

Rank Citing Paper Year Venue Pagerank
1,065 Are We Ready For Learned Cardinality Estimation? 2021 VLDB 0.00012202293
1,432 Towards a Learning Optimizer for Shared Clouds 2019 VLDB 0.00010676754
1,747 Selecting Subexpressions to Materialize at Datacenter Scale 2018 VLDB 9.7303647e-05
2,833 Cost Models for Big Data Query Processing: Learning, Retrofitting, and Our Findings 2020 SIGMOD 7.9539771e-05
3,446 Apache Hive: From MapReduce to Enterprise-grade Big Data Warehousing 2019 SIGMOD 7.2908619e-05
3,895 Hyper Dimension Shuffle: Efficient Data Repartition at Petabyte Scale in SCOPE 2019 VLDB 6.9360458e-05
3,948 Deploying a Steered Query Optimizer in Production at Microsoft 2022 SIGMOD 6.9051584e-05
5,110 Steering Query Optimizers: A Practical Take on Big Data Workloads 2021 SIGMOD 6.2678118e-05
5,451 Crystal: A Unified Cache Storage System for Analytical Databases 2021 VLDB 6.1238308e-05
5,700 PilotScope: Steering Databases with Machine Learning Drivers 2024 VLDB 6.028998e-05
5,774 Optimizing Data Pipelines for Machine Learning in Feature Stores 2023 VLDB 5.9959266e-05
6,248 The Cosmos Big Data Platform at Microsoft: Over a Decade of Progress and a Decade to Look Forward 2021 VLDB 5.8345657e-05
6,579 Towards Query Optimizer as a Service (QOaaS) in a Unified LakeHouse Ecosystem: Can One QO Rule Them All? 2025 CIDR 5.7421583e-05
6,820 CrocodileDB: Efficient Database Execution through Intelligent Deferment 2020 CIDR 5.6708756e-05
7,160 Sibyl: Forecasting Time-Evolving Query Workloads 2024 SIGMOD 5.5945786e-05
7,388 Lachesis: Automatic Partitioning for UDF-Centric Analytics 2021 VLDB 5.5355684e-05
7,767 AutoToken: Predicting Peak Parallelism for Big Data Analytics at Microsoft 2020 VLDB 5.4550466e-05
7,813 Machine Learning for Cloud Data Systems: the Progress so far and the Path Forward 2021 VLDB 5.4474823e-05
8,171 Pangea: Monolithic Distributed Storage for Data Analytics 2019 VLDB 5.3826392e-05
8,349 SparkCruise: Workload Optimization in Managed Spark Clusters at Microsoft 2021 VLDB 5.3485189e-05
8,357 Towards Building Autonomous Data Services on Azure 2023 SIGMOD 5.3463255e-05
8,704 View Selection over Knowledge Graphs in Triple Stores 2021 VLDB 5.2880532e-05
8,972 GEqO: ML-Accelerated Semantic Equivalence Detection 2023 SIGMOD 5.2469075e-05
9,098 Hyperspace: The Indexing Subsystem of Azure Synapse 2021 VLDB 5.2258409e-05
9,367 Phoebe: A Learning-based Checkpoint Optimizer 2021 VLDB 5.1845217e-05
9,645 QURE: AI-Assisted and Automatically Verified UDF Inlining 2025 SIGMOD 5.1437878e-05
9,714 Hippo: Sharing Computations in Hyper-Parameter Optimization 2022 VLDB 5.1347788e-05
9,999 SparkCruise: Handsfree Computation Reuse in Spark 2019 VLDB 5.0964027e-05
10,138 Cquirrel: Continuous Query Processing over Acyclic Relational Schemas 2021 VLDB 5.0727027e-05
10,905 Benchmarking the Full Pipeline of Materialized-View-Based Query Rewriting 2026 VLDB 4.9769913e-05
13,718 PikePlace: Generating Intelligence for Marketplace Datasets 2023 VLDB -
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 26 of 26 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
11 Implementing Data Cubes Efficiently 1996 SIGMOD 0.00071056708
15 How Good Are Query Optimizers, Really? 2016 VLDB 0.00061067652
30 SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets 2008 VLDB 0.00050475202
31 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB 0.00049821554
88 Automated Selection of Materialized Views and Indexes for SQL Databases 2000 VLDB 0.00035340164
98 LEO - DB2's LEarning Optimizer 2001 VLDB 0.00034099838
129 Efficient and Extensible Algorithms for Multi Query Optimization 2000 SIGMOD 0.00030395767
149 Efficient Mid-Query Re-Optimization of Sub-Optimal Query Execution Plans 1998 SIGMOD 0.00028977821
471 Robust Query Processing through Progressive Optimization 2004 SIGMOD 0.00017744392
509 Goods: Organizing Google's Datasets 2016 SIGMOD 0.00017063491
704 Main-Memory Scan Sharing For Multi-Core CPUs 2008 VLDB 0.00014653079
762 Cooperative Scans: Dynamic Bandwidth Sharing in a DBMS 2007 VLDB 0.00014134432
823 MRShare: Sharing Across Multiple Queries in MapReduce 2010 VLDB 0.00013642066
837 Proactive Re-Optimization 2005 SIGMOD 0.00013551072
1,132 Efficient Exploitation of Similar Subexpressions for Query Processing 2007 SIGMOD 0.00011893781
1,549 Data Warehouse Configuration 1997 VLDB 0.00010287654
1,925 ReStore: Reusing Results of MapReduce Jobs 2012 VLDB 9.3643089e-05
2,086 An Architecture for Recycling Intermediates in a Column-store 2009 SIGMOD 9.0677901e-05
2,225 Shared Workload Optimization 2014 VLDB 8.8062552e-05
3,217 Multi-Query Optimization in MapReduce Framework 2014 VLDB 7.5199872e-05
4,069 Dynamically Optimizing Queries over Large Scale Data Platforms 2014 SIGMOD 6.8184364e-05
4,732 MQJoin: Efficient Shared Execution of Main-Memory Joins 2016 VLDB 6.4439712e-05
4,820 Continuous Cloud-Scale Query Optimization and Processing 2013 VLDB 6.3935932e-05
5,091 ROBUS: Fair Cache Allocation for Data-parallel Workloads 2017 SIGMOD 6.2775613e-05
7,365 Kodiak: Leveraging Materialized Views For Very Low-Latency Analytics Over High-Dimensional Web-Scale Data 2016 VLDB 5.5401198e-05
8,033 Dependency-Driven Analytics: a Compass for Uncharted Data Oceans 2017 CIDR 5.4017733e-05
Previous Page 1 / 1 Next

Semantically Similar Papers