Opportunistic Physical Design for Big Data Analytics

Summary: Treats materialized intermediates from exploratory MapReduce jobs as an opportunistic physical design. Proposes a semantic UDF model to reuse UDF-containing views and a minimum-cost rewrite algorithm (with provable guarantees); Hive prototype shows dramatic speedups. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 4884
Venue: SIGMOD
Year: 2014
Pagerank: 5.2194019e-05
Overall Rank: 6,079 | 57.76%
DOI: 10.1145/2685555.2680152

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 6 of 6 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,921	Selecting Subexpressions to Materialize at Datacenter Scale	2018	VLDB	0.00010085899
3,565	MISO: Souping Up Big Data Query Processing with a Multistore System	2014	SIGMOD	6.9627613e-05
5,578	CliffGuard: A Principled Framework for Finding Robust Database Designs	2015	SIGMOD	5.4231783e-05
7,557	Invisible Glue: Scalable Self-Tuning Multi-Stores	2015	CIDR	4.7070194e-05
8,435	Not Black-Box Anymore! Enabling Analytics-Aware Optimizations in Teradata Vantage	2021	VLDB	4.5075971e-05
9,032	Making Data Clouds Smarter at Keebo: Automated Warehouse Optimization using Data Learning	2023	SIGMOD	4.3998185e-05

Outgoing Citations (Sorted by Pagerank)

Showing 18 of 18 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
82	Answering Queries Using Views (Extended Abstract)	1995	PODS	0.00054430106
139	The MADlib Analytics Library or MAD Skills, the SQL	2012	VLDB	0.00042320525
160	Automated Selection of Materialized Views and Indexes for SQL Databases	2000	VLDB	0.00040053897
539	Shark: SQL and Rich Analytics at Scale	2013	SIGMOD	0.00020615453
728	Optimizing Queries Using Materialized Views: A Practical, Scalable Solution	2001	SIGMOD	0.00017459654
947	MRShare: Sharing Across Multiple Queries in MapReduce	2010	VLDB	0.00015112344
981	Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads	2012	VLDB	0.00014866268
1,059	Answering Complex SQL Queries Using Automatic Summary Tables	2000	SIGMOD	0.00014370009
1,155	A Scalable Algorithm for Answering Queries Using Views	2000	VLDB	0.00013606507
2,211	ReStore: Reusing Results of MapReduce Jobs	2012	VLDB	9.2823037e-05
2,476	A Platform for Scalable One-Pass Analytics using MapReduce	2011	SIGMOD	8.6907971e-05
2,616	Opening the Black Boxes in Data Flow Optimization	2012	VLDB	8.4457819e-05
3,565	MISO: Souping Up Big Data Query Processing with a Multistore System	2014	SIGMOD	6.9627613e-05
3,714	Optimizing Analytic Data Flows for Multiple Execution Engines	2012	SIGMOD	6.8176849e-05
4,084	On the Content of Materialized Aggregate Views	2000	PODS	6.4581296e-05
5,144	Scalable Query Rewriting: A Graph-Based Approach	2011	SIGMOD	5.6597671e-05
6,817	Hadoop's Adolescence: An analysis of Hadoop usage in scientific workloads	2013	VLDB	4.9110239e-05
9,015	Odyssey: A Multi-Store System for Evolutionary Analytics	2013	VLDB	4.4058722e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
728	Optimizing Queries Using Materialized Views: A Practical, Scalable Solution	2001	SIGMOD	0.00017459654
1,911	Algorithms for Materialized View Design in Data Warehousing Environment	1997	VLDB	0.00010117173
158	HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads	2009	VLDB	0.00040401371
9,505	Supporting Scalable Analytics with Latency Constraints	2015	VLDB	4.3300131e-05
3,709	Multi-Query Optimization in MapReduce Framework	2014	VLDB	6.8211506e-05
866	Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs	2011	VLDB	0.00015771189
2,476	A Platform for Scalable One-Pass Analytics using MapReduce	2011	SIGMOD	8.6907971e-05
6,777	Revisiting Reuse in Main Memory Database Systems	2017	SIGMOD	4.9242249e-05
981	Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads	2012	VLDB	0.00014866268
5,012	Dynamically Optimizing Queries over Large Scale Data Platforms	2014	SIGMOD	5.7543101e-05