Incorporating Super-Operators in Big-Data Query Optimizers

Summary: Super-operators replace shuffle-heavy subqueries with a single streaming operator. An op-tree model and fast rule matching bound the search space; SCOPE implements parametric super-operators, delivering 1.7x cost and 1.5x latency with no optimization-time penalty. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 12230
Venue: VLDB
Year: 2020
Pagerank: 4.966799e-05
Overall Rank: 6,673 | 53.58%
DOI: 10.14778/3368289.3368299

Incoming Non-self Citations Over Time

Authors

1. Jyoti Leeka
2. Kaushik Rajan

Incoming Citations (Sorted by Pagerank)

Showing 10 of 10 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
5,125	The Art of Balance: A RateupDBTM Experience of Building a CPU/GPU Hybrid Database Product	2021	VLDB	5.679423e-05
6,261	The Cosmos Big Data Platform at Microsoft: Over a Decade of Progress and a Decade to Look Forward	2021	VLDB	5.1350714e-05
8,094	Modularis: Modular Relational Analytics over Heterogeneous Distributed Platforms	2021	VLDB	4.5867812e-05
8,345	SlabCity: Whole-Query Optimization using Program Synthesis	2023	VLDB	4.5426916e-05
8,645	Predicate Pushdown for Data Science Pipelines	2023	SIGMOD	4.4772518e-05
9,194	Phoebe: A Learning-based Checkpoint Optimizer	2021	VLDB	4.3761777e-05
9,330	Parallel Query Processing: To Separate Communication from Computation	2022	SIGMOD	4.3556432e-05
9,457	Sharing Opportunities for OLTP Workloads in Different Isolation Levels	2020	VLDB	4.3382555e-05
9,993	Leveraging Query Optimizers to Verify the Soundness of LLM-based Query Rewrites for Real-World Workloads, and More!	2026	CIDR	4.1945683e-05
10,897	Welding Natural Language Queries to Analytics IRs with LLMs	2024	CIDR	4.1945683e-05

Outgoing Citations (Sorted by Pagerank)

Showing 12 of 12 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
60	Efficiently Compiling Efficient Query Plans for Modern Hardware	2011	VLDB	0.00064439773
66	Spark SQL: Relational Data Processing in Spark	2015	SIGMOD	0.00061639801
70	Hive - A Warehousing Solution Over a Map-Reduce Framework	2009	VLDB	0.00059533166
426	Amazon Redshift and the Case for Simpler Data Warehouses	2015	SIGMOD	0.00023594359
639	Orthogonal Optimization of Subqueries and Aggregation	2001	SIGMOD	0.00018791492
704	Building Efficient Query Engines in a High-Level Language	2014	VLDB	0.00017900583
1,869	WinMagic : Subquery Elimination Using Window Aggregation	2003	SIGMOD	0.00010265836
1,948	Groupwise Processing of Relational Queries	1997	VLDB	9.989482e-05
3,038	Azure Data Lake Store: A Hyperscale Distributed File Service for Big Data Analytics	2017	SIGMOD	7.6717218e-05
3,277	A Layered Aggregate Engine for Analytics Workloads	2019	SIGMOD	7.2871625e-05
3,560	Counting, Enumerating, and Sampling of Execution Plans in a Cost-Based Query Optimizer	2000	SIGMOD	6.9723858e-05
4,248	Hyper Dimension Shuffle: Efficient Data Repartition at Petabyte Scale in SCOPE	2019	VLDB	6.3247927e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
2,925	Shared Workload Optimization	2014	VLDB	7.888494e-05
1,429	A Scalable, Predictable Join Operator for Highly Concurrent Data Warehouses	2009	VLDB	0.00012033518
1,476	Efficient Exploitation of Similar Subexpressions for Query Processing	2007	SIGMOD	0.00011779092
8,506	New Query Optimization Techniques in the Spark Engine of Azure Synapse	2022	VLDB	4.4957661e-05
3,625	Cost Models for Big Data Query Processing: Learning, Retrofitting, and Our Findings	2020	SIGMOD	6.9055212e-05
5,297	Continuous Cloud-Scale Query Optimization and Processing	2013	VLDB	5.5801669e-05
5,014	Dynamically Optimizing Queries over Large Scale Data Platforms	2014	SIGMOD	5.7586174e-05
2,611	Opening the Black Boxes in Data Flow Optimization	2012	VLDB	8.4536967e-05
4,248	Hyper Dimension Shuffle: Efficient Data Repartition at Petabyte Scale in SCOPE	2019	VLDB	6.3247927e-05
6,040	Steering Query Optimizers: A Practical Take on Big Data Workloads	2021	SIGMOD	5.2412035e-05