Flexible Rule-Based Decomposition and Metadata Independence in Modin: A Parallel Dataframe System
Summary: Modin parallelizes pandas through formal rule-based columnar, row-wise, and cell-wise decompositions, while lazily decoupling metadata from physical layout. This enables broad, scalable row/column operation support beyond Dask DataFrames and Koalas. (summarized by gpt-5.6-luna on Jul 24 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Devin Petersohn (University of California Berkeley)
- 2. Dixin Tang (University of California Berkeley)
- 3. Rehan Durrani (University of California Berkeley)
- 4. Areg Melik-Adamyan (Intel)
- 5. Joseph E. Gonzalez (University of California Berkeley)
- 6. Anthony D. Joseph (University of California Berkeley)
- 7. Aditya G. Parameswaran (University of California Berkeley)
BibTeX Citation
@article{petersohn_vldb22,
title = {{Flexible Rule-Based Decomposition and Metadata Independence in Modin: A Parallel Dataframe System}},
author = {Petersohn, Devin and Tang, Dixin and Durrani, Rehan and Melik-Adamyan, Areg and Gonzalez, Joseph E. and Joseph, Anthony D. and Parameswaran, Aditya G.},
journal = {PVLDB},
series = {{VLDB} '22},
volume = {15},
number = {3},
pages = {739--751},
doi = {10.14778/3494124.3494152},
url = {https://doi.org/10.14778/3494124.3494152},
year = {2022}
}
Incoming Citations (Sorted by Pagerank)
Showing 5 of 5 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 3,180 | A Critique of Modern SQL And A Proposal Towards A Simple and Expressive Query Language | 2024 | CIDR | 7.5639428e-05 |
| 6,662 | UPLIFT: Parallelization Strategies for Feature Transformations in Machine Learning Workloads | 2022 | VLDB | 5.7171651e-05 |
| 7,269 | Decentralized Actor Scheduling and Reference-based Storage in Xorbits: a Native Scalable Data Science Engine | 2025 | VLDB | 5.5694935e-05 |
| 9,637 | QURE: AI-Assisted and Automatically Verified UDF Inlining | 2025 | SIGMOD | 5.1462239e-05 |
| 10,278 | Dias: Dynamic Rewriting of Pandas Code | 2024 | SIGMOD | 5.0455234e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 16 of 16 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 2,723 | Exploiting Matrix Dependency for Efficient Distributed Matrix Computation | 2015 | SIGMOD |
| 2 | 3,384 | Putting Pandas in a Box | 2021 | CIDR |
| 3 | 8,376 | Meta-Dataflows: Efficient Exploratory Dataflow Jobs | 2018 | SIGMOD |
| 4 | 1,193 | Weld: A Common Runtime for High Performance Data Analytics | 2017 | CIDR |
| 5 | 9,246 | DQDF: Data-Quality-Aware Dataframes | 2022 | VLDB |
| 6 | 11,570 | SplitDF: Splitting Dataframes for Memory-Efficient Data Analysis | 2024 | VLDB |
| 7 | 10,995 | Painless and Efficient Scaling of Pandas Programs: Demo | 2026 | VLDB |
| 8 | 4,815 | PolyFrame: A Retargetable Query-based Approach to Scaling Dataframes | 2021 | VLDB |
| 9 | 7,451 | Modularis: Modular Relational Analytics over Heterogeneous Distributed Platforms | 2021 | VLDB |
| 10 | 1,369 | Towards Scalable Dataframe Systems | 2020 | VLDB |