Agile-Ant: Self-managing Distributed Cache Management for Cost Optimization of Big Data Applications

Summary: Agile-Ant self-manages distributed in-memory clusters by identifying hot datasets and auto-scaling memory to cache them on-the-fly without app/data/resource priors or human tuning. Aims for cost-optimal caching under multi-tenancy; reduces execution cost 78.3% vs baseline and beats prior approaches. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 13531
Venue: VLDB
Year: 2024
Pagerank: 4.1905499e-05
Overall Rank: 11,059 | 23.14%
DOI: 10.14778/3681954.3681990

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank

Outgoing Citations (Sorted by Pagerank)

Showing 12 of 12 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
66	Spark SQL: Relational Data Processing in Spark	2015	SIGMOD	0.00061707583
167	The Snowflake Elastic Data Warehouse	2016	SIGMOD	0.00039408116
203	Learned Cardinalities: Estimating Correlated Joins with Deep Learning	2019	CIDR	0.00034868567
980	Anti-Caching: A New Approach to Database Management System Architecture	2013	VLDB	0.00014868633
1,048	Starfish: A Self-tuning System for Big Data Analytics	2011	CIDR	0.00014442178
1,104	Cardinality Estimation Done Right: Index-Based Join Sampling	2017	CIDR	0.0001398479
1,683	Cardinality Estimation: An Experimental Survey	2018	VLDB	0.0001091276
1,892	Black or White? How to Develop an AutoTuner for Memory-based Analytics	2020	SIGMOD	0.00010176219
5,446	Using Cloud Functions as Accelerator for Elastic Data Analytics	2023	SIGMOD	5.4986799e-05
5,699	PREDIcT: Towards Predicting the Runtime of Large Scale Iterative Analytics	2013	VLDB	5.3655096e-05
11,343	Juggler: Autonomous Cost Optimization and Performance Prediction of Big Data Applications	2022	SIGMOD	4.1905499e-05
11,408	SparkCAD: Caching Anomalies Detector for Spark Applications	2022	VLDB	4.1905499e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
8,758	Caching at the Web Scale	2017	VLDB	4.4520434e-05
2,545	Efficient Distributed Memory Management with RDMA and Caching	2018	VLDB	8.5616487e-05
6,152	Crystal: A Unified Cache Storage System for Analytical Databases	2021	VLDB	5.1802666e-05
9,505	Supporting Scalable Analytics with Latency Constraints	2015	VLDB	4.3300131e-05
3,234	Managing Large Dynamic Graphs Efficiently	2012	SIGMOD	7.3302974e-05
253	Query Caching and Optimization in Distributed Mediator Systems	1996	SIGMOD	0.00030517335
980	Anti-Caching: A New Approach to Database Management System Architecture	2013	VLDB	0.00014868633
10,346	Linear Elastic Caching via Ski Rental	2025	CIDR	4.1905499e-05
5,304	ReCache: Reactive Caching for Fast Analytics over Heterogeneous Data	2018	VLDB	5.5738777e-05
11,343	Juggler: Autonomous Cost Optimization and Performance Prediction of Big Data Applications	2022	SIGMOD	4.1905499e-05