Opportunistic Physical Design for Big Data Analytics

Summary: Treats materialized intermediates from exploratory MapReduce jobs as an opportunistic physical design. Proposes a semantic UDF model to reuse UDF-containing views and a minimum-cost rewrite algorithm (with provable guarantees); Hive prototype shows dramatic speedups. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 4883
Venue: SIGMOD
Year: 2014
Pagerank: 5.223901e-05
Overall Rank: 6,075 | 57.74%
DOI: 10.1145/2685555.2680152

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 6 of 6 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,922	Selecting Subexpressions to Materialize at Datacenter Scale	2018	VLDB	0.00010082599
3,562	MISO: Souping Up Big Data Query Processing with a Multistore System	2014	SIGMOD	6.9694564e-05
5,581	CliffGuard: A Principled Framework for Finding Robust Database Designs	2015	SIGMOD	5.424205e-05
7,557	Invisible Glue: Scalable Self-Tuning Multi-Stores	2015	CIDR	4.7112819e-05
8,444	Not Black-Box Anymore! Enabling Analytics-Aware Optimizations in Teradata Vantage	2021	VLDB	4.5118994e-05
9,074	Making Data Clouds Smarter at Keebo: Automated Warehouse Optimization using Data Learning	2023	SIGMOD	4.402065e-05

Outgoing Citations (Sorted by Pagerank)

Showing 18 of 18 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
82	Answering Queries Using Views (Extended Abstract)	1995	PODS	0.00054402763
140	The MADlib Analytics Library or MAD Skills, the SQL	2012	VLDB	0.00042270404
158	Automated Selection of Materialized Views and Indexes for SQL Databases	2000	VLDB	0.00040071492
542	Shark: SQL and Rich Analytics at Scale	2013	SIGMOD	0.00020595648
731	Optimizing Queries Using Materialized Views: A Practical, Scalable Solution	2001	SIGMOD	0.00017468889
947	MRShare: Sharing Across Multiple Queries in MapReduce	2010	VLDB	0.00015114576
979	Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads	2012	VLDB	0.0001488055
1,059	Answering Complex SQL Queries Using Automatic Summary Tables	2000	SIGMOD	0.00014382575
1,155	A Scalable Algorithm for Answering Queries Using Views	2000	VLDB	0.00013616518
2,205	ReStore: Reusing Results of MapReduce Jobs	2012	VLDB	9.2920002e-05
2,476	A Platform for Scalable One-Pass Analytics using MapReduce	2011	SIGMOD	8.6960139e-05
2,611	Opening the Black Boxes in Data Flow Optimization	2012	VLDB	8.4536967e-05
3,562	MISO: Souping Up Big Data Query Processing with a Multistore System	2014	SIGMOD	6.9694564e-05
3,710	Optimizing Analytic Data Flows for Multiple Execution Engines	2012	SIGMOD	6.8238962e-05
4,082	On the Content of Materialized Aggregate Views	2000	PODS	6.4639136e-05
5,144	Scalable Query Rewriting: A Graph-Based Approach	2011	SIGMOD	5.6651982e-05
6,821	Hadoop's Adolescence: An analysis of Hadoop usage in scientific workloads	2013	VLDB	4.9156923e-05
9,009	Odyssey: A Multi-Store System for Evolutionary Analytics	2013	VLDB	4.4100992e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
1,911	Algorithms for Materialized View Design in Data Warehousing Environment	1997	VLDB	0.00010120234
731	Optimizing Queries Using Materialized Views: A Practical, Scalable Solution	2001	SIGMOD	0.00017468889
157	HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads	2009	VLDB	0.00040397359
9,504	Supporting Scalable Analytics with Latency Constraints	2015	VLDB	4.3341665e-05
3,703	Multi-Query Optimization in MapReduce Framework	2014	VLDB	6.8289978e-05
868	Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs	2011	VLDB	0.00015789681
2,476	A Platform for Scalable One-Pass Analytics using MapReduce	2011	SIGMOD	8.6960139e-05
6,777	Revisiting Reuse in Main Memory Database Systems	2017	SIGMOD	4.9288776e-05
979	Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads	2012	VLDB	0.0001488055
5,014	Dynamically Optimizing Queries over Large Scale Data Platforms	2014	SIGMOD	5.7586174e-05