Flexible Rule-Based Decomposition and Metadata Independence in Modin: A Parallel Dataframe System
Summary: Modin parallelizes pandas through formal rule-based columnar, row-wise, and cell-wise decompositions, while lazily decoupling metadata from physical layout. This enables broad, scalable row/column operation support beyond Dask DataFrames and Koalas. (summarized by gpt-5.6-luna on Jul 24 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Devin Petersohn (University of California Berkeley)
- 2. Dixin Tang (University of California Berkeley)
- 3. Rehan Durrani (University of California Berkeley)
- 4. Areg Melik-Adamyan (Intel)
- 5. Joseph E. Gonzalez (University of California Berkeley)
- 6. Anthony D. Joseph (University of California Berkeley)
- 7. Aditya G. Parameswaran (University of California Berkeley)
BibTeX Citation
@article{petersohn_vldb22,
title = {{Flexible Rule-Based Decomposition and Metadata Independence in Modin: A Parallel Dataframe System}},
author = {Petersohn, Devin and Tang, Dixin and Durrani, Rehan and Melik-Adamyan, Areg and Gonzalez, Joseph E. and Joseph, Anthony D. and Parameswaran, Aditya G.},
journal = {PVLDB},
series = {{VLDB} '22},
volume = {15},
number = {3},
pages = {739--751},
doi = {10.14778/3494124.3494152},
url = {https://doi.org/10.14778/3494124.3494152},
year = {2022}
}
Incoming Citations (Sorted by Pagerank)
Showing 5 of 5 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 4,796 | A Critique of Modern SQL And A Proposal Towards A Simple and Expressive Query Language | 2024 | CIDR | 6.5031952e-05 |
| 6,538 | UPLIFT: Parallelization Strategies for Feature Transformations in Machine Learning Workloads | 2022 | VLDB | 5.8477764e-05 |
| 7,502 | Decentralized Actor Scheduling and Reference-based Storage in Xorbits: a Native Scalable Data Science Engine | 2025 | VLDB | 5.6029996e-05 |
| 9,456 | QURE: AI-Assisted and Automatically Verified UDF Inlining | 2025 | SIGMOD | 5.2643416e-05 |
| 10,074 | Dias: Dynamic Rewriting of Pandas Code | 2024 | SIGMOD | 5.1613298e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 16 of 16 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 10,074 | Dias: Dynamic Rewriting of Pandas Code | 2024 | SIGMOD |
| 2 | 2,681 | Exploiting Matrix Dependency for Efficient Distributed Matrix Computation | 2015 | SIGMOD |
| 3 | 4,292 | Putting Pandas in a Box | 2021 | CIDR |
| 4 | 8,237 | Meta-Dataflows: Efficient Exploratory Dataflow Jobs | 2018 | SIGMOD |
| 5 | 1,229 | Weld: A Common Runtime for High Performance Data Analytics | 2017 | CIDR |
| 6 | 9,069 | DQDF: Data-Quality-Aware Dataframes | 2022 | VLDB |
| 7 | 11,235 | SplitDF: Splitting Dataframes for Memory-Efficient Data Analysis | 2024 | VLDB |
| 8 | 4,728 | PolyFrame: A Retargetable Query-based Approach to Scaling Dataframes | 2021 | VLDB |
| 9 | 7,899 | Modularis: Modular Relational Analytics over Heterogeneous Distributed Platforms | 2021 | VLDB |
| 10 | 1,431 | Towards Scalable Dataframe Systems | 2020 | VLDB |