Incorporating Super-Operators in Big-Data Query Optimizers

Summary: Super-operators replace shuffle-heavy subqueries with a single streaming operator. An op-tree model and fast rule matching bound the search space; SCOPE implements parametric super-operators, delivering 1.7x cost and 1.5x latency with no optimization-time penalty. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 12231
Venue: VLDB
Year: 2020
Pagerank: 4.9625353e-05
Overall Rank: 6,671 | 53.64%
DOI: 10.14778/3368289.3368299

Incoming Non-self Citations Over Time

Authors

1. Jyoti Leeka
2. Kaushik Rajan

Incoming Citations (Sorted by Pagerank)

Showing 10 of 10 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
5,129	The Art of Balance: A RateupDBTM Experience of Building a CPU/GPU Hybrid Database Product	2021	VLDB	5.6724875e-05
6,278	The Cosmos Big Data Platform at Microsoft: Over a Decade of Progress and a Decade to Look Forward	2021	VLDB	5.1241654e-05
8,098	Modularis: Modular Relational Analytics over Heterogeneous Distributed Platforms	2021	VLDB	4.5824106e-05
8,339	SlabCity: Whole-Query Optimization using Program Synthesis	2023	VLDB	4.5383933e-05
8,625	Predicate Pushdown for Data Science Pipelines	2023	SIGMOD	4.4784651e-05
9,138	Phoebe: A Learning-based Checkpoint Optimizer	2021	VLDB	4.3842765e-05
9,335	Parallel Query Processing: To Separate Communication from Computation	2022	SIGMOD	4.351469e-05
9,459	Sharing Opportunities for OLTP Workloads in Different Isolation Levels	2020	VLDB	4.3340981e-05
9,992	Leveraging Query Optimizers to Verify the Soundness of LLM-based Query Rewrites for Real-World Workloads, and More!	2026	CIDR	4.1905499e-05
10,901	Welding Natural Language Queries to Analytics IRs with LLMs	2024	CIDR	4.1905499e-05

Outgoing Citations (Sorted by Pagerank)

Showing 12 of 12 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
59	Efficiently Compiling Efficient Query Plans for Modern Hardware	2011	VLDB	0.0006445664
66	Spark SQL: Relational Data Processing in Spark	2015	SIGMOD	0.00061707583
70	Hive - A Warehousing Solution Over a Map-Reduce Framework	2009	VLDB	0.00059744625
424	Amazon Redshift and the Case for Simpler Data Warehouses	2015	SIGMOD	0.00023604384
640	Orthogonal Optimization of Subqueries and Aggregation	2001	SIGMOD	0.00018780632
701	Building Efficient Query Engines in a High-Level Language	2014	VLDB	0.00017893039
1,871	WinMagic : Subquery Elimination Using Window Aggregation	2003	SIGMOD	0.0001025746
1,952	Groupwise Processing of Relational Queries	1997	VLDB	9.9806285e-05
3,044	Azure Data Lake Store: A Hyperscale Distributed File Service for Big Data Analytics	2017	SIGMOD	7.6624689e-05
3,280	A Layered Aggregate Engine for Analytics Workloads	2019	SIGMOD	7.2813732e-05
3,563	Counting, Enumerating, and Sampling of Execution Plans in a Cost-Based Query Optimizer	2000	SIGMOD	6.9686532e-05
4,226	Hyper Dimension Shuffle: Efficient Data Repartition at Petabyte Scale in SCOPE	2019	VLDB	6.3382156e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
2,928	Shared Workload Optimization	2014	VLDB	7.881485e-05
1,430	A Scalable, Predictable Join Operator for Highly Concurrent Data Warehouses	2009	VLDB	0.0001202506
1,475	Efficient Exploitation of Similar Subexpressions for Query Processing	2007	SIGMOD	0.00011765071
8,502	New Query Optimization Techniques in the Spark Engine of Azure Synapse	2022	VLDB	4.491819e-05
3,623	Cost Models for Big Data Query Processing: Learning, Retrofitting, and Our Findings	2020	SIGMOD	6.9017341e-05
5,309	Continuous Cloud-Scale Query Optimization and Processing	2013	VLDB	5.5714729e-05
5,012	Dynamically Optimizing Queries over Large Scale Data Platforms	2014	SIGMOD	5.7543101e-05
2,616	Opening the Black Boxes in Data Flow Optimization	2012	VLDB	8.4457819e-05
4,226	Hyper Dimension Shuffle: Efficient Data Repartition at Petabyte Scale in SCOPE	2019	VLDB	6.3382156e-05
5,994	Steering Query Optimizers: A Practical Take on Big Data Workloads	2021	SIGMOD	5.2367998e-05