Piranha: Optimizing Short Jobs in Hadoop

Summary: Piranha targets Hadoop’s overlooked short, latency-sensitive warehouse queries amid batch workloads. Deployable without modifying Hadoop, it exploits production-derived short-job characteristics to cut response times by up to 71% without affecting large jobs. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: 10947
Venue: VLDB
Year: 2013
Pagerank: 5.4226e-05
Overall Rank: 8,455 | 42.00%
DOI: 10.14778/2536222.2536227

Incoming Non-self Citations Over Time

Authors

1. Khaled Elmeleegy (Turn Inc.)

BibTeX Citation

@article{elmeleegy_vldb13,
        title = {{Piranha: Optimizing Short Jobs in Hadoop}},
        author = {Elmeleegy, Khaled},
        journal = {PVLDB},
        series = {{VLDB} '13},
        volume = {6},
        number = {11},
        pages = {985--996},
        doi = {10.14778/2536222.2536227},
        url = {https://doi.org/10.14778/2536222.2536227},
        year = {2013}
}

Incoming Citations (Sorted by Pagerank)

Showing 4 of 4 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
7,238	Kodiak: Leveraging Materialized Views For Very Low-Latency Analytics Over High-Dimensional Web-Scale Data	2016	VLDB	5.664642e-05
9,137	SpongeFiles: Mitigating Data Skew in MapReduce Using Distributed Memory	2014	SIGMOD	5.3162511e-05
11,399	QaaD (Query-as-a-Data): Scalable Execution of Massive Number of Small Queries in Spark	2023	SIGMOD	5.093636e-05
11,539	Juggler: Autonomous Cost Optimization and Performance Prediction of Big Data Applications	2022	SIGMOD	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 10 of 10 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
6	Pig Latin: A Not-So-Foreign Language for Data Processing	2008	SIGMOD	0.0010686205
32	Hive - A Warehousing Solution Over a Map-Reduce Framework	2009	VLDB	0.00050111008
51	Dremel: Interactive Analysis of Web-Scale Datasets	2010	VLDB	0.0004291425
120	HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads	2009	VLDB	0.00031680027
425	Shark: SQL and Rich Analytics at Scale	2013	SIGMOD	0.00018704491
660	Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing)	2010	VLDB	0.00015198804
872	Tenzing: A SQL Implementation On The MapReduce Framework	2011	VLDB	0.00013486409
1,436	The Performance of MapReduce: An In-depth Study	2010	VLDB	0.00010797443
1,791	Cheetah: A High Performance, Custom Data Warehouse on Top of MapReduce	2010	VLDB	9.7470504e-05
1,794	Distributed Data-Parallel Computing Using a High-Level Programming Language	2009	SIGMOD	9.7399162e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	12,131	FP-Hadoop: Efficient Execution of Parallel Jobs Over Skewed Data	2015	VLDB
2	1,791	Cheetah: A High Performance, Custom Data Warehouse on Top of MapReduce	2010	VLDB
3	13,581	Job Scheduling with Minimizing Data Communication Costs	2015	SIGMOD
4	12,156	Shared Execution of Recurring Workloads in MapReduce	2015	VLDB
5	12,298	Optimization Strategies for A/B Testing on HADOOP	2013	VLDB
6	9,640	Supporting Scalable Analytics with Latency Constraints	2015	VLDB
7	660	Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing)	2010	VLDB
8	2,159	Efficient Processing of Data Warehousing Queries in a Split Execution Environment	2011	SIGMOD
9	3,163	Multi-Query Optimization in MapReduce Framework	2014	VLDB
10	1,436	The Performance of MapReduce: An In-depth Study	2010	VLDB