Piranha: Optimizing Short Jobs in Hadoop

Summary: Piranha targets Hadoop’s overlooked short, latency-sensitive warehouse queries amid batch workloads. Deployable without modifying Hadoop, it exploits production-derived short-job characteristics to cut response times by up to 71% without affecting large jobs. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: h66b551130b7cafc2
Venue: VLDB
Year: 2013
Pagerank: 5.3009314e-05
Overall Rank: 8,624 | 42.02%
DOI: 10.14778/2536222.2536227

Incoming Non-self Citations Over Time

Authors

1. Khaled Elmeleegy (Turn Inc.)

BibTeX Citation

@article{elmeleegy_vldb13,
        title = {{Piranha: Optimizing Short Jobs in Hadoop}},
        author = {Elmeleegy, Khaled},
        journal = {PVLDB},
        series = {{VLDB} '13},
        volume = {6},
        number = {11},
        pages = {985--996},
        doi = {10.14778/2536222.2536227},
        url = {https://doi.org/10.14778/2536222.2536227},
        year = {2013}
}

Incoming Citations (Sorted by Pagerank)

Showing 4 of 4 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
7,360	Kodiak: Leveraging Materialized Views For Very Low-Latency Analytics Over High-Dimensional Web-Scale Data	2016	VLDB	5.5427171e-05
9,307	SpongeFiles: Mitigating Data Skew in MapReduce Using Distributed Memory	2014	SIGMOD	5.197526e-05
11,714	QaaD (Query-as-a-Data): Scalable Execution of Massive Number of Small Queries in Spark	2023	SIGMOD	4.9793485e-05
11,848	Juggler: Autonomous Cost Optimization and Performance Prediction of Big Data Applications	2022	SIGMOD	4.9793485e-05

Outgoing Citations (Sorted by Pagerank)

Showing 10 of 10 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
6	Pig Latin: A Not-So-Foreign Language for Data Processing	2008	SIGMOD	0.001052036
31	Hive - A Warehousing Solution Over a Map-Reduce Framework	2009	VLDB	0.00049839909
49	Dremel: Interactive Analysis of Web-Scale Datasets	2010	VLDB	0.00043160717
120	HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads	2009	VLDB	0.000311132
432	Shark: SQL and Rich Analytics at Scale	2013	SIGMOD	0.00018339357
673	Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing)	2010	VLDB	0.0001488755
876	Tenzing: A SQL Implementation On The MapReduce Framework	2011	VLDB	0.00013309176
1,466	The Performance of MapReduce: An In-depth Study	2010	VLDB	0.00010569837
1,810	Distributed Data-Parallel Computing Using a High-Level Programming Language	2009	SIGMOD	9.5892079e-05
1,837	Cheetah: A High Performance, Custom Data Warehouse on Top of MapReduce	2010	VLDB	9.5350058e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	12,424	FP-Hadoop: Efficient Execution of Parallel Jobs Over Skewed Data	2015	VLDB
2	1,837	Cheetah: A High Performance, Custom Data Warehouse on Top of MapReduce	2010	VLDB
3	13,894	Job Scheduling with Minimizing Data Communication Costs	2015	SIGMOD
4	12,447	Shared Execution of Recurring Workloads in MapReduce	2015	VLDB
5	12,589	Optimization Strategies for A/B Testing on HADOOP	2013	VLDB
6	9,816	Supporting Scalable Analytics with Latency Constraints	2015	VLDB
7	2,173	Efficient Processing of Data Warehousing Queries in a Split Execution Environment	2011	SIGMOD
8	673	Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing)	2010	VLDB
9	3,216	Multi-Query Optimization in MapReduce Framework	2014	VLDB
10	1,466	The Performance of MapReduce: An In-depth Study	2010	VLDB