Parallelism-Optimizing Data Placement for Faster Data-Parallel Computations
Summary: Shows that minimizing tail latency for data-parallel queries requires placing items so each query's accesses are spread across many machines to maximize per-query parallelism. Proposes a linear computable parallelism metric and a scalable partitioning-based placement optimizer; 7–64% p99 improvements on Solr/MongoDB. (summarized by gpt-5-mini on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Nirvik Baruah (Stanford University)
- 2. Peter Kraft (Stanford University)
- 3. Fiodar Kazhamiaka (Stanford University)
- 4. Peter Bailis (Stanford University)
- 5. Matei Zaharia (Stanford University)
BibTeX Citation
@article{baruah_vldb23,
title = {{Parallelism-Optimizing Data Placement for Faster Data-Parallel Computations}},
author = {Baruah, Nirvik and Kraft, Peter and Kazhamiaka, Fiodar and Bailis, Peter and Zaharia, Matei},
journal = {PVLDB},
series = {{VLDB} '23},
volume = {16},
number = {4},
pages = {760--771},
doi = {10.14778/3574245.3574260},
url = {https://doi.org/10.14778/3574245.3574260},
year = {2023}
}Incoming Citations (Sorted by Pagerank)
Showing 3 of 3 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 9,020 | Optimizing the cloud? Don't train models. Build oracles! | 2024 | CIDR | 5.2355482e-05 |
| 9,911 | SkyPIE: A Fast & Accurate Oracle for Object Placement | 2024 | SIGMOD | 5.1103839e-05 |
| 10,755 | A Resource-centric Analysis and Optimization of NoSQL Workloads using Distressed Resource Volume Metric | 2026 | VLDB | 4.9793485e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 6 of 6 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 123 | Schism: a Workload-Driven Approach to Database Replication and Partitioning | 2010 | VLDB | 0.00030762995 |
| 890 | E-Store: Fine-Grained Elastic Partitioning for Distributed Transaction Processing Systems | 2015 | VLDB | 0.00013247078 |
| 1,236 | Druid: A Real-time Analytical Data Store | 2014 | SIGMOD | 0.00011402848 |
| 2,288 | Clay: Fine-Grained Adaptive Partitioning for General Database Schemas | 2017 | VLDB | 8.6912082e-05 |
| 3,058 | Accordion: Elastic Scalability for Database Systems Supporting Distributed Transactions | 2014 | VLDB | 7.6964255e-05 |
| 5,159 | NashDB: An End-to-End Economic Method for Elastic Database Fragmentation, Replication, and Provisioning | 2018 | SIGMOD | 6.2482448e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 977 | Parallel Evaluation of Conjunctive Queries | 2011 | PODS |
| 2 | 3,775 | Parallelizing Query Optimization | 2008 | VLDB |
| 3 | 6,136 | Parallelizing Extensible Query Optimizers | 2009 | SIGMOD |
| 4 | 6,288 | Elastic Pipelining in an In-Memory Database Cluster | 2016 | SIGMOD |
| 5 | 3,091 | Parallel Query Scheduling and Optimization with Time- and Space-Shared Resources | 1997 | VLDB |
| 6 | 1,883 | Automated Partitioning Design in Parallel Database Systems | 2011 | SIGMOD |
| 7 | 7,967 | Resource Bricolage for Parallel Database Systems | 2015 | VLDB |
| 8 | 446 | Query Optimization for Parallel Execution | 1992 | SIGMOD |
| 9 | 2,168 | Optimization Algorithms for Exploiting the Parallelism-Communication Tradeoff in Pipelined Parallelism | 1994 | VLDB |
| 10 | 9,621 | Parallelizing Query Optimization on Shared-Nothing Architectures | 2016 | VLDB |