Scaling a Declarative Cluster Manager Architecture with Query Optimization Techniques

Summary: C-SQL: a formal SQL-like language to express cluster placement as constraint optimization. Using query-optimizer techniques (incremental view maintenance, predicate pushdown) scales DCM to 10^4 nodes, yielding ~3000× DB latency speedup and up to 300× reduction in problem size (Kubernetes scheduler case study). (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 13107
Venue: VLDB
Year: 2023
Pagerank: 4.6462265e-05
Overall Rank: 7,805 | 45.71%
DOI: 10.14778/3603581.3603599

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 1 of 1 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
5,566	Solver-In-The-Loop Cluster Resource Management for Database-as-a-Service	2023	VLDB	5.4316888e-05

Outgoing Citations (Sorted by Pagerank)

Showing 19 of 19 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
95	Maintaining Views Incrementally	1993	SIGMOD	0.00050896659
139	Predicate Migration: Optimizing Queries with Expensive Predicates	1993	SIGMOD	0.00042299329
316	NoScope: Optimizing Neural Network Queries over Video at Scale	2017	VLDB	0.00027988668
329	Accelerating Machine Learning Inference with Probabilistic Predicates	2018	SIGMOD	0.00027249545
401	View Maintenance in a Warehousing Environment	1995	SIGMOD	0.00024214488
481	Incremental Maintenance of Views with Duplicates	1995	SIGMOD	0.00022167223
522	Differential dataflow	2013	CIDR	0.00021099241
586	DBToaster: Higher-order Delta Processing for Dynamic, Frequently Fresh Views	2012	VLDB	0.00019685374
1,112	Materialized View Selection and Maintenance Using Multi-Query Optimization	2001	SIGMOD	0.00013917776
1,302	Query Optimization by Predicate Move-Around	1994	VLDB	0.00012705525
1,313	Cost-Based Optimization for Magic: Algebra and Implementation	1996	SIGMOD	0.0001263831
1,421	Algorithms for Deferred View Maintenance	1996	SIGMOD	0.0001205793
2,022	Lazy Maintenance of Materialized Views	2007	VLDB	9.754634e-05
2,611	Opening the Black Boxes in Data Flow Optimization	2012	VLDB	8.4536967e-05
3,688	DBOS: A DBMS-oriented Operating System	2022	VLDB	6.8414694e-05
4,192	Operator Placement for In-Network Stream Query Processing	2005	PODS	6.3727539e-05
4,199	Implementation of Magic-sets in a Relational Database System	1994	SIGMOD	6.3662839e-05
7,173	CONSTRAINT QUERY LANGUAGES (preliminary report)	1990	PODS	4.8114568e-05
8,066	Optimizing Iceberg Queries with Complex Joins	2017	SIGMOD	4.5937212e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
7,413	On Scale Independence for Querying Big Data	2014	PODS	4.7358047e-05
10,726	Improving DBMS Scheduling Decisions with Accurate Performance Prediction on Concurrent Queries	2025	VLDB	4.1945683e-05
10,408	Managed Resource Scaling in Amazon EMR	2025	SIGMOD	4.1945683e-05
7,715	Query Centric Partitioning and Allocation for Partially Replicated Database Systems	2017	SIGMOD	4.6699261e-05
1,322	Automated Demand-driven Resource Scaling in Relational Database-as-a-Service	2016	SIGMOD	0.00012610912
6,061	Towards Energy-Efficient Database Cluster Design	2012	VLDB	5.2304505e-05
5,014	Dynamically Optimizing Queries over Large Scale Data Platforms	2014	SIGMOD	5.7586174e-05
8,861	A Model for Query Execution Over Heterogeneous Instances	2024	CIDR	4.4331977e-05
9,305	Parallelizing Query Optimization on Shared-Nothing Architectures	2016	VLDB	4.3577129e-05
5,297	Continuous Cloud-Scale Query Optimization and Processing	2013	VLDB	5.5801669e-05