Flexible Rule-Based Decomposition and Metadata Independence in Modin: A Parallel Dataframe System
Summary: Modin parallelizes pandas through formal rule-based columnar, row-wise, and cell-wise decompositions, while lazily decoupling metadata from physical layout. This enables broad, scalable row/column operation support beyond Dask DataFrames and Koalas. (summarized by gpt-5.6-luna on Jul 24 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Devin Petersohn (University of California Berkeley)
- 2. Dixin Tang (University of California Berkeley)
- 3. Rehan Durrani (University of California Berkeley)
- 4. Areg Melik-Adamyan (Intel)
- 5. Joseph E. Gonzalez (University of California Berkeley)
- 6. Anthony D. Joseph (University of California Berkeley)
- 7. Aditya G. Parameswaran (University of California Berkeley)
BibTeX Citation
@article{petersohn_vldb22,
title = {{Flexible Rule-Based Decomposition and Metadata Independence in Modin: A Parallel Dataframe System}},
author = {Petersohn, Devin and Tang, Dixin and Durrani, Rehan and Melik-Adamyan, Areg and Gonzalez, Joseph E. and Joseph, Anthony D. and Parameswaran, Aditya G.},
journal = {PVLDB},
series = {{VLDB} '22},
volume = {15},
number = {3},
pages = {739--751},
doi = {10.14778/3494124.3494152},
url = {https://doi.org/10.14778/3494124.3494152},
year = {2022}
}
Incoming Citations (Sorted by Pagerank)
Showing 5 of 5 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 3,181 | A Critique of Modern SQL And A Proposal Towards A Simple and Expressive Query Language | 2024 | CIDR | 7.5603717e-05 |
| 6,666 | UPLIFT: Parallelization Strategies for Feature Transformations in Machine Learning Workloads | 2022 | VLDB | 5.7144587e-05 |
| 7,272 | Decentralized Actor Scheduling and Reference-based Storage in Xorbits: a Native Scalable Data Science Engine | 2025 | VLDB | 5.5668569e-05 |
| 9,645 | QURE: AI-Assisted and Automatically Verified UDF Inlining | 2025 | SIGMOD | 5.1437878e-05 |
| 10,284 | Dias: Dynamic Rewriting of Pandas Code | 2024 | SIGMOD | 5.0431349e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 16 of 16 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 2,724 | Exploiting Matrix Dependency for Efficient Distributed Matrix Computation | 2015 | SIGMOD |
| 2 | 3,385 | Putting Pandas in a Box | 2021 | CIDR |
| 3 | 8,381 | Meta-Dataflows: Efficient Exploratory Dataflow Jobs | 2018 | SIGMOD |
| 4 | 1,193 | Weld: A Common Runtime for High Performance Data Analytics | 2017 | CIDR |
| 5 | 9,256 | DQDF: Data-Quality-Aware Dataframes | 2022 | VLDB |
| 6 | 11,576 | SplitDF: Splitting Dataframes for Memory-Efficient Data Analysis | 2024 | VLDB |
| 7 | 11,004 | Painless and Efficient Scaling of Pandas Programs: Demo | 2026 | VLDB |
| 8 | 4,817 | PolyFrame: A Retargetable Query-based Approach to Scaling Dataframes | 2021 | VLDB |
| 9 | 7,455 | Modularis: Modular Relational Analytics over Heterogeneous Distributed Platforms | 2021 | VLDB |
| 10 | 1,370 | Towards Scalable Dataframe Systems | 2020 | VLDB |