Database Paper Browser

Back to papers

Selecting Subexpressions to Materialize at Datacenter Scale

Summary: BigSubs: an ILP-based method to select and materialize overlapping subexpressions across tens of thousands of shared analytics jobs. A distributed, vertex-centric algorithm solves a bipartite graph labeling formulation in SCOPE, delivering up to 40% machine-hours savings at datacenter scale. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
11786
Venue
VLDB
Year
2018
Pagerank
0.00010085899
Overall Rank
1,921 | 86.66%
DOI
10.14778/3192965.3192971

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 36 of 36 citing papers.

Rank Citing Paper Year Venue Pagerank
1,666 HELIX: Holistic Optimization for Accelerating Iterative Machine Learning 2019 VLDB 0.00010955907
3,610 EVA: A Symbolic Approach to Accelerating Exploratory Video Analytics with Materialized Views 2022 SIGMOD 6.919859e-05
3,623 Cost Models for Big Data Query Processing: Learning, Retrofitting, and Our Findings 2020 SIGMOD 6.9017341e-05
3,903 Automated Verification of Query Equivalence Using Satisfiability Modulo Theories 2019 VLDB 6.6439695e-05
4,151 openGauss: An Autonomous Database System 2021 VLDB 6.4020605e-05
4,621 Automated Generation of Materialized Views in Oracle 2020 VLDB 6.036749e-05
4,779 LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems 2021 SIGMOD 5.9259373e-05
5,001 GenRewrite: Query Rewriting via Large Language Models 2026 SIGMOD 5.7634197e-05
5,575 Optimizing Data Pipelines for Machine Learning in Feature Stores 2023 VLDB 5.4253204e-05
5,941 Eraser: Eliminating Performance Regression on Learned Query Optimizer 2024 VLDB 5.2594013e-05
6,152 Crystal: A Unified Cache Storage System for Analytical Databases 2021 VLDB 5.1802666e-05
6,278 The Cosmos Big Data Platform at Microsoft: Over a Decade of Progress and a Decade to Look Forward 2021 VLDB 5.1241654e-05
6,986 CrocodileDB: Efficient Database Execution through Intelligent Deferment 2020 CIDR 4.8672517e-05
7,127 Jigsaw: A Data Storage and Query Processing Engine for Irregular Table Partitioning 2021 SIGMOD 4.8184276e-05
7,291 Multi-Tenant Cloud Data Services: State-of-the-Art, Challenges and Opportunities 2022 SIGMOD 4.7677422e-05
7,397 Intermittent Query Processing 2019 VLDB 4.7367491e-05
7,461 Scalable Multi-Query Execution using Reinforcement Learning 2021 SIGMOD 4.7193668e-05
7,809 Sibyl: Forecasting Time-Evolving Query Workloads 2024 SIGMOD 4.6415559e-05
8,196 SparkCruise: Workload Optimization in Managed Spark Clusters at Microsoft 2021 VLDB 4.5568952e-05
8,288 View Selection over Knowledge Graphs in Triple Stores 2021 VLDB 4.5392079e-05
8,434 SageDB: An Instance-Optimized Data Analytics System 2022 VLDB 4.5077955e-05
8,502 New Query Optimization Techniques in the Spark Engine of Azure Synapse 2022 VLDB 4.491819e-05
8,754 Hyperspace: The Indexing Subsystem of Azure Synapse 2021 VLDB 4.4520434e-05
8,780 GEqO: ML-Accelerated Semantic Equivalence Detection 2023 SIGMOD 4.4485568e-05
8,854 Optimizing the cloud? Don't train models. Build oracles! 2024 CIDR 4.4306537e-05
9,138 Phoebe: A Learning-based Checkpoint Optimizer 2021 VLDB 4.3842765e-05
9,422 When sweet and cute isn't enough anymore: Solving scalability issues in Python Pandas with Grizzly 2020 CIDR 4.3399748e-05
9,734 SparkCruise: Handsfree Computation Reuse in Spark 2019 VLDB 4.2901665e-05
9,798 UniView: A Unified Autonomous Materialized View Management System for Various Databases 2024 VLDB 4.2777144e-05
9,818 Generating Application-Specific Data Layouts for In-memory Databases 2019 VLDB 4.2733415e-05
10,767 SIEVE: Effective Filtered Vector Search with Collection of Indexes 2025 VLDB 4.1905499e-05
10,854 Mayura: Exploiting Similarities in Motifs for Temporal Co-Mining 2025 VLDB 4.1905499e-05
10,894 Oligolithic Cross-task Optimizations across Isolated Workloads* 2024 CIDR 4.1905499e-05
11,199 QaaD (Query-as-a-Data): Scalable Execution of Massive Number of Small Queries in Spark 2023 SIGMOD 4.1905499e-05
11,343 Juggler: Autonomous Cost Optimization and Performance Prediction of Big Data Applications 2022 SIGMOD 4.1905499e-05
13,210 PikePlace: Generating Intelligence for Marketplace Datasets 2023 VLDB -
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 27 of 27 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
4 Pregel: A System for Large-Scale Graph Processing 2010 SIGMOD 0.0019040811
11 Implementing Data Cubes Efficiently 1996 SIGMOD 0.0011695087
41 NiagaraCQ: A Scalable Continuous Query System for Internet Databases 2000 SIGMOD 0.00073944756
70 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB 0.00059744625
160 Automated Selection of Materialized Views and Indexes for SQL Databases 2000 VLDB 0.00040053897
179 Efficient and Extensible Algorithms for Multi Query Optimization 2000 SIGMOD 0.00037637319
590 TelegraphCQ: Continuous Dataflow Processing 2003 SIGMOD 0.00019552343
826 Main-Memory Scan Sharing For Multi-Core CPUs 2008 VLDB 0.00016161625
847 The case against specialized graph analytics engines 2015 CIDR 0.00015939766
947 MRShare: Sharing Across Multiple Queries in MapReduce 2010 VLDB 0.00015112344
1,027 Cooperative Scans: Dynamic Bandwidth Sharing in a DBMS 2007 VLDB 0.0001458537
1,360 Data Warehouse Configuration 1997 VLDB 0.0001239983
1,475 Efficient Exploitation of Similar Subexpressions for Query Processing 2007 SIGMOD 0.00011765071
2,211 ReStore: Reusing Results of MapReduce Jobs 2012 VLDB 9.2823037e-05
2,695 An Architecture for Recycling Intermediates in a Column-store 2009 SIGMOD 8.2827669e-05
2,711 Vertexica: Your Relational Friend for Graph Analytics! 2014 VLDB 8.2548656e-05
2,928 Shared Workload Optimization 2014 VLDB 7.881485e-05
3,044 Azure Data Lake Store: A Hyperscale Distributed File Service for Big Data Analytics 2017 SIGMOD 7.6624689e-05
3,505 Efficient and Provable Multi-Query Optimization 2017 PODS 7.0304901e-05
3,709 Multi-Query Optimization in MapReduce Framework 2014 VLDB 6.8211506e-05
4,171 Computation Reuse in Analytics Job Service at Microsoft 2018 SIGMOD 6.3800823e-05
4,772 Recurring Job Optimization in Scope 2012 SIGMOD 5.9280555e-05
6,079 Opportunistic Physical Design for Big Data Analytics 2014 SIGMOD 5.2194019e-05
7,205 Kodiak: Leveraging Materialized Views For Very Low-Latency Analytics Over High-Dimensional Web-Scale Data 2016 VLDB 4.7965293e-05
7,690 ROBUS: Fair Cache Allocation for Data-parallel Workloads 2017 SIGMOD 4.6723821e-05
8,248 View Selection in Semantic Web Databases 2012 VLDB 4.5453997e-05
8,826 Delta: Scalable Data Dissemination under Capacity Constraints 2014 VLDB 4.4371065e-05
Previous Page 1 / 1 Next

Semantically Similar Papers