Automating Distributed Tiered Storage Management in Cluster Computing

Summary: Automates distributed storage tiering across HDFS tiers with a general framework. Uses incremental ML to predict file accesses and trigger migrations, adapting to workload changes; evaluation shows gains in performance and cluster efficiency. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 12246
Venue: VLDB
Year: 2020
Pagerank: 5.2080102e-05
Overall Rank: 6,104 | 57.54%
DOI: 10.14778/3357377.3357381

Incoming Non-self Citations Over Time

Authors

1. Herodotos Herodotou
2. Elena Kakoulli

Incoming Citations (Sorted by Pagerank)

Showing 6 of 6 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
6,803	Proteus: Autonomous Adaptive Storage for Mixed Workloads	2022	SIGMOD	4.9224958e-05
8,491	SA-LSM: Optimize Data Layout for LSM-tree Based Storage using Survival Analysis	2022	VLDB	4.4993073e-05
9,094	FEC: Efficient Deep Recommendation Model Training with Flexible Embedding Communication	2023	SIGMOD	4.3980444e-05
9,546	Trident: Task Scheduling over Tiered Storage Systems in Big Data Platforms	2021	VLDB	4.3259935e-05
9,858	VIP Hashing - Adapting to Skew in Popularity of Data on the Fly	2022	VLDB	4.269353e-05
10,402	CloudJump II: Optimizing Cloud Databases for Shared Storage	2025	SIGMOD	4.1945683e-05

Outgoing Citations (Sorted by Pagerank)

Showing 6 of 6 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
979	Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads	2012	VLDB	0.0001488055
2,076	Trekking Through Siberia: Managing Cold Data in a Memory-Optimized Database	2014	VLDB	9.6059442e-05
2,223	SkimpyStash: RAM Space Skimpy Key-Value Store on Flash-based Storage	2011	SIGMOD	9.2568088e-05
2,476	A Platform for Scalable One-Pass Analytics using MapReduce	2011	SIGMOD	8.6960139e-05
3,689	Compacting Transactional Data in Hybrid OLTP&OLAP Databases	2012	VLDB	6.8396366e-05
4,861	OctopusFS: A Distributed File System with Tiered Storage Management	2017	SIGMOD	5.8708916e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
6,268	Speedup Your Analytics: Automatic Parameter Tuning for Databases and Big Data Systems	2019	VLDB	5.133857e-05
6,279	Self-Organizing Data Containers	2022	CIDR	5.1295282e-05
4,015	Take me to your leader! Online Optimization of Distributed Storage Configurations	2015	VLDB	6.5272549e-05
4,802	Resource Elasticity for Large-Scale Machine Learning	2015	SIGMOD	5.9114415e-05
6,802	Understanding Insights into the Basic Structure and Essential Issues of Table Placement Methods in Clusters	2013	VLDB	4.9226626e-05
5,558	A Hadoop Based Distributed Loading Approach to Parallel Data Warehouses	2011	SIGMOD	5.4341353e-05
3,659	Autoscaling Tiered Cloud Storage in Anna	2019	VLDB	6.8696023e-05
13,321	OctopusFS in Action: Tiered Storage Management for Data Intensive Computing	2018	VLDB	-
9,546	Trident: Task Scheduling over Tiered Storage Systems in Big Data Platforms	2021	VLDB	4.3259935e-05
4,861	OctopusFS: A Distributed File System with Tiered Storage Management	2017	SIGMOD	5.8708916e-05