Scaling a Declarative Cluster Manager Architecture with Query Optimization Techniques

Summary: C-SQL: a formal SQL-like language to express cluster placement as constraint optimization. Using query-optimizer techniques (incremental view maintenance, predicate pushdown) scales DCM to 10^4 nodes, yielding ~3000× DB latency speedup and up to 300× reduction in problem size (Kubernetes scheduler case study). (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 13108
Venue: VLDB
Year: 2023
Pagerank: 4.6417687e-05
Overall Rank: 7,807 | 45.75%
DOI: 10.14778/3603581.3603599

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 1 of 1 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
5,574	Solver-In-The-Loop Cluster Resource Management for Database-as-a-Service	2023	VLDB	5.4264731e-05

Outgoing Citations (Sorted by Pagerank)

Showing 19 of 19 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
97	Maintaining Views Incrementally	1993	SIGMOD	0.00050863077
140	Predicate Migration: Optimizing Queries with Expensive Predicates	1993	SIGMOD	0.00042289025
317	NoScope: Optimizing Neural Network Queries over Video at Scale	2017	VLDB	0.0002798145
332	Accelerating Machine Learning Inference with Probabilistic Predicates	2018	SIGMOD	0.00027173479
402	View Maintenance in a Warehousing Environment	1995	SIGMOD	0.00024179174
482	Incremental Maintenance of Views with Duplicates	1995	SIGMOD	0.00022145976
524	Differential dataflow	2013	CIDR	0.00021093133
585	DBToaster: Higher-order Delta Processing for Dynamic, Frequently Fresh Views	2012	VLDB	0.00019682634
1,110	Materialized View Selection and Maintenance Using Multi-Query Optimization	2001	SIGMOD	0.00013902997
1,303	Query Optimization by Predicate Move-Around	1994	VLDB	0.00012692678
1,313	Cost-Based Optimization for Magic: Algebra and Implementation	1996	SIGMOD	0.00012629432
1,428	Algorithms for Deferred View Maintenance	1996	SIGMOD	0.00012030912
2,026	Lazy Maintenance of Materialized Views	2007	VLDB	9.7466372e-05
2,616	Opening the Black Boxes in Data Flow Optimization	2012	VLDB	8.4457819e-05
3,688	DBOS: A DBMS-oriented Operating System	2022	VLDB	6.8370783e-05
4,192	Operator Placement for In-Network Stream Query Processing	2005	PODS	6.3666236e-05
4,198	Implementation of Magic-sets in a Relational Database System	1994	SIGMOD	6.361961e-05
7,174	CONSTRAINT QUERY LANGUAGES (preliminary report)	1990	PODS	4.8068344e-05
8,070	Optimizing Iceberg Queries with Complex Joins	2017	SIGMOD	4.5893281e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
7,917	Terabyte-Scale Analytics in the Blink of an Eye	2026	VLDB	4.6129625e-05
10,733	Improving DBMS Scheduling Decisions with Accurate Performance Prediction on Concurrent Queries	2025	VLDB	4.1905499e-05
10,419	Managed Resource Scaling in Amazon EMR	2025	SIGMOD	4.1905499e-05
7,713	Query Centric Partitioning and Allocation for Partially Replicated Database Systems	2017	SIGMOD	4.6662571e-05
1,321	Automated Demand-driven Resource Scaling in Relational Database-as-a-Service	2016	SIGMOD	0.00012605455
6,065	Towards Energy-Efficient Database Cluster Design	2012	VLDB	5.2254299e-05
5,012	Dynamically Optimizing Queries over Large Scale Data Platforms	2014	SIGMOD	5.7543101e-05
8,861	A Model for Query Execution Over Heterogeneous Instances	2024	CIDR	4.4289485e-05
9,312	Parallelizing Query Optimization on Shared-Nothing Architectures	2016	VLDB	4.353536e-05
5,309	Continuous Cloud-Scale Query Optimization and Processing	2013	VLDB	5.5714729e-05