Automating Distributed Tiered Storage Management in Cluster Computing

Summary: Automates distributed storage tiering across HDFS tiers with a general framework. Uses incremental ML to predict file accesses and trigger migrations, adapting to workload changes; evaluation shows gains in performance and cluster efficiency. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: hedd75a46c38efae4
Venue: VLDB
Year: 2020
Pagerank: 6.8591707e-05
Overall Rank: 4,008 | 73.06%
DOI: 10.14778/3357377.3357381

Incoming Non-self Citations Over Time

Authors

1. Herodotos Herodotou (Cyprus University of Technology)
2. Elena Kakoulli (Cyprus University of Technology)

BibTeX Citation

@article{herodotou_vldb20,
        title = {{Automating Distributed Tiered Storage Management in Cluster Computing}},
        author = {Herodotou, Herodotos and Kakoulli, Elena},
        journal = {PVLDB},
        series = {{VLDB} '20},
        volume = {13},
        number = {1},
        pages = {43--56},
        doi = {10.14778/3357377.3357381},
        url = {https://doi.org/10.14778/3357377.3357381},
        year = {2020}
}

Incoming Citations (Sorted by Pagerank)

Showing 8 of 8 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
6,598	Proteus: Autonomous Adaptive Storage for Mixed Workloads	2022	SIGMOD	5.7405915e-05
8,530	SA-LSM: Optimize Data Layout for LSM-tree Based Storage using Survival Analysis	2022	VLDB	5.3222993e-05
9,302	VIP Hashing - Adapting to Skew in Popularity of Data on the Fly	2022	VLDB	5.1979758e-05
9,339	FEC: Efficient Deep Recommendation Model Training with Flexible Embedding Communication	2023	SIGMOD	5.1910676e-05
9,823	Trident: Task Scheduling over Tiered Storage Systems in Big Data Platforms	2021	VLDB	5.1254334e-05
9,948	CloudJump II: Optimizing Cloud Databases for Shared Storage	2025	SIGMOD	5.1038322e-05
10,496	ReStore: A Reinforcement Learning Approach for Data Migration in Multi-Tiered Storage	2026	SIGMOD	4.9793485e-05
10,994	ReStore-in-Action: Adaptive Multi-Tier Storage Management via Intelligent Data Migration Policy	2026	VLDB	4.9793485e-05

Outgoing Citations (Sorted by Pagerank)

Showing 6 of 6 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
1,072	Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads	2012	VLDB	0.00012168947
1,524	Trekking Through Siberia: Managing Cold Data in a Memory-Optimized Database	2014	VLDB	0.00010356318
1,665	SkimpyStash: RAM Space Skimpy Key-Value Store on Flash-based Storage	2011	SIGMOD	9.9384098e-05
2,282	A Platform for Scalable One-Pass Analytics using MapReduce	2011	SIGMOD	8.6964781e-05
3,308	Compacting Transactional Data in Hybrid OLTP&OLAP Databases	2012	VLDB	7.4411187e-05
5,315	OctopusFS: A Distributed File System with Tiered Storage Management	2017	SIGMOD	6.1841352e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	4,116	Resource Elasticity for Large-Scale Machine Learning	2015	SIGMOD
2	3,976	Take me to your leader! Online Optimization of Distributed Storage Configurations	2015	VLDB
3	6,763	Understanding Insights into the Basic Structure and Essential Issues of Table Placement Methods in Clusters	2013	VLDB
4	6,422	A Hadoop Based Distributed Loading Approach to Parallel Data Warehouses	2011	SIGMOD
5	3,028	Autoscaling Tiered Cloud Storage in Anna	2019	VLDB
6	10,994	ReStore-in-Action: Adaptive Multi-Tier Storage Management via Intelligent Data Migration Policy	2026	VLDB
7	10,496	ReStore: A Reinforcement Learning Approach for Data Migration in Multi-Tiered Storage	2026	SIGMOD
8	13,835	OctopusFS in Action: Tiered Storage Management for Data Intensive Computing	2018	VLDB
9	9,823	Trident: Task Scheduling over Tiered Storage Systems in Big Data Platforms	2021	VLDB
10	5,315	OctopusFS: A Distributed File System with Tiered Storage Management	2017	SIGMOD