Parallelism-Optimizing Data Placement for Faster Data-Parallel Computations
Summary: Shows that minimizing tail latency for data-parallel queries requires placing items so each query's accesses are spread across many machines to maximize per-query parallelism. Proposes a linear computable parallelism metric and a scalable partitioning-based placement optimizer; 7–64% p99 improvements on Solr/MongoDB. (summarized by gpt-5-mini on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Nirvik Baruah (Stanford University)
- 2. Peter Kraft (Stanford University)
- 3. Fiodar Kazhamiaka (Stanford University)
- 4. Peter Bailis (Stanford University)
- 5. Matei Zaharia (Stanford University)
BibTeX Citation
@article{baruah_vldb23,
title = {{Parallelism-Optimizing Data Placement for Faster Data-Parallel Computations}},
author = {Baruah, Nirvik and Kraft, Peter and Kazhamiaka, Fiodar and Bailis, Peter and Zaharia, Matei},
journal = {PVLDB},
series = {{VLDB} '23},
volume = {16},
number = {4},
pages = {760--771},
doi = {10.14778/3574245.3574260},
url = {https://doi.org/10.14778/3574245.3574260},
year = {2023}
}Incoming Citations (Sorted by Pagerank)
Showing 2 of 2 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 8,861 | Optimizing the cloud? Don't train models. Build oracles! | 2024 | CIDR | 5.355716e-05 |
| 9,735 | SkyPIE: A Fast & Accurate Oracle for Object Placement | 2024 | SIGMOD | 5.227679e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 6 of 6 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 126 | Schism: a Workload-Driven Approach to Database Replication and Partitioning | 2010 | VLDB | 0.00030779127 |
| 887 | E-Store: Fine-Grained Elastic Partitioning for Distributed Transaction Processing Systems | 2015 | VLDB | 0.00013403455 |
| 1,242 | Druid: A Real-time Analytical Data Store | 2014 | SIGMOD | 0.00011516162 |
| 2,363 | Clay: Fine-Grained Adaptive Partitioning for General Database Schemas | 2017 | VLDB | 8.6873235e-05 |
| 3,218 | Accordion: Elastic Scalability for Database Systems Supporting Distributed Transactions | 2014 | VLDB | 7.6312132e-05 |
| 5,072 | NashDB: An End-to-End Economic Method for Elastic Database Fragmentation, Replication, and Provisioning | 2018 | SIGMOD | 6.3753956e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 954 | Parallel Evaluation of Conjunctive Queries | 2011 | PODS |
| 2 | 3,726 | Parallelizing Query Optimization | 2008 | VLDB |
| 3 | 6,026 | Parallelizing Extensible Query Optimizers | 2009 | SIGMOD |
| 4 | 6,255 | Elastic Pipelining in an In-Memory Database Cluster | 2016 | SIGMOD |
| 5 | 3,046 | Parallel Query Scheduling and Optimization with Time- and Space-Shared Resources | 1997 | VLDB |
| 6 | 1,852 | Automated Partitioning Design in Parallel Database Systems | 2011 | SIGMOD |
| 7 | 7,822 | Resource Bricolage for Parallel Database Systems | 2015 | VLDB |
| 8 | 434 | Query Optimization for Parallel Execution | 1992 | SIGMOD |
| 9 | 2,131 | Optimization Algorithms for Exploiting the Parallelism-Communication Tradeoff in Pipelined Parallelism | 1994 | VLDB |
| 10 | 9,446 | Parallelizing Query Optimization on Shared-Nothing Architectures | 2016 | VLDB |