Agile-Ant: Self-managing Distributed Cache Management for Cost Optimization of Big Data Applications

Summary: Agile-Ant self-manages distributed in-memory clusters by identifying hot datasets and auto-scaling memory to cache them on-the-fly without app/data/resource priors or human tuning. Aims for cost-optimal caching under multi-tenancy; reduces execution cost 78.3% vs baseline and beats prior approaches. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 13530
Venue: VLDB
Year: 2024
Pagerank: 4.1945683e-05
Overall Rank: 11,056 | 23.09%
DOI: 10.14778/3681954.3681990

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank

Outgoing Citations (Sorted by Pagerank)

Showing 12 of 12 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
66	Spark SQL: Relational Data Processing in Spark	2015	SIGMOD	0.00061639801
167	The Snowflake Elastic Data Warehouse	2016	SIGMOD	0.00039180521
204	Learned Cardinalities: Estimating Correlated Joins with Deep Learning	2019	CIDR	0.00034784455
982	Anti-Caching: A New Approach to Database Management System Architecture	2013	VLDB	0.00014872253
1,071	Starfish: A Self-tuning System for Big Data Analytics	2011	CIDR	0.00014312777
1,105	Cardinality Estimation Done Right: Index-Based Join Sampling	2017	CIDR	0.00013990395
1,683	Cardinality Estimation: An Experimental Survey	2018	VLDB	0.00010922679
1,902	Black or White? How to Develop an AutoTuner for Memory-based Analytics	2020	SIGMOD	0.00010157713
5,441	Using Cloud Functions as Accelerator for Elastic Data Analytics	2023	SIGMOD	5.5028093e-05
5,688	PREDIcT: Towards Predicting the Runtime of Large Scale Iterative Analytics	2013	VLDB	5.3702808e-05
11,341	Juggler: Autonomous Cost Optimization and Performance Prediction of Big Data Applications	2022	SIGMOD	4.1945683e-05
11,405	SparkCAD: Caching Anomalies Detector for Spark Applications	2022	VLDB	4.1945683e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
8,762	Caching at the Web Scale	2017	VLDB	4.456315e-05
2,572	Efficient Distributed Memory Management with RDMA and Caching	2018	VLDB	8.519943e-05
6,149	Crystal: A Unified Cache Storage System for Analytical Databases	2021	VLDB	5.1847534e-05
9,504	Supporting Scalable Analytics with Latency Constraints	2015	VLDB	4.3341665e-05
3,232	Managing Large Dynamic Graphs Efficiently	2012	SIGMOD	7.336861e-05
253	Query Caching and Optimization in Distributed Mediator Systems	1996	SIGMOD	0.00030569863
982	Anti-Caching: A New Approach to Database Management System Architecture	2013	VLDB	0.00014872253
10,334	Linear Elastic Caching via Ski Rental	2025	CIDR	4.1945683e-05
5,301	ReCache: Reactive Caching for Fast Analytics over Heterogeneous Data	2018	VLDB	5.5790928e-05
11,341	Juggler: Autonomous Cost Optimization and Performance Prediction of Big Data Applications	2022	SIGMOD	4.1945683e-05