Back to papers
Towards Scalable Dataframe Systems
Summary: Scalable dataframe systems via MODIN; scaling pandas-like APIs with a simple dataframe data model and algebra. Signature features: flexible schemas, ordering, row/column equivalence, data/metadata fluidity; a trial-and-error interaction model spurs open data-management research.
(summarized by gpt-5-nano on Feb 09 2026)
- Paper ID
- 12098
- Venue
- VLDB
- Year
- 2020
- Pagerank
- 0.00012033503
- Overall Rank
- 1,427 | 90.09%
- DOI
-
10.14778/3407790.3407807
Incoming Non-self Citations Over Time
Incoming Citations (Sorted by Pagerank)
Showing 21 of 21 citing papers.
| Rank |
Citing Paper |
Year |
Venue |
Pagerank |
| 2,090 |
Balsa: Learning a Query Optimizer Without Expert Demonstrations |
2022 |
SIGMOD |
9.5668285e-05 |
| 2,955 |
Magpie: Python at Speed and Scale using Cloud Backends |
2021 |
CIDR |
7.8188583e-05 |
| 3,260 |
Query Processing on Tensor Computation Runtimes |
2022 |
VLDB |
7.3091312e-05 |
| 3,393 |
Lux: Always-on Visualization Recommendations for Exploratory Dataframe Workflows |
2022 |
VLDB |
7.1415762e-05 |
| 3,772 |
Flexible Rule-Based Decomposition and Metadata Independence in Modin: A Parallel Dataframe System |
2022 |
VLDB |
6.7736479e-05 |
| 4,241 |
The Composable Data Management System Manifesto |
2023 |
VLDB |
6.3258298e-05 |
| 4,776 |
PolyFrame: A Retargetable Query-based Approach to Scaling Dataframes |
2021 |
VLDB |
5.9263134e-05 |
| 5,311 |
A Critique of Modern SQL And A Proposal Towards A Simple and Expressive Query Language |
2024 |
CIDR |
5.5712968e-05 |
| 5,984 |
DataPrep.EDA: Task-Centric Exploratory Data Analysis for Statistical Modeling in Python |
2021 |
SIGMOD |
5.2400405e-05 |
| 6,539 |
ConnectorX: Accelerating Data Loading From Databases to Dataframes |
2022 |
VLDB |
5.0168759e-05 |
| 6,898 |
Decentralized Actor Scheduling and Reference-based Storage in Xorbits: a Native Scalable Data Science Engine |
2025 |
VLDB |
4.8878659e-05 |
| 8,166 |
Capturing and Querying Fine-grained Provenance of Preprocessing Pipelines in Data Science |
2021 |
VLDB |
4.567959e-05 |
| 8,253 |
Automating and Optimizing Data-Centric What-If Analyses on Native Machine Learning Pipelines |
2023 |
SIGMOD |
4.5444167e-05 |
| 8,515 |
UPLIFT: Parallelization Strategies for Feature Transformations in Machine Learning Workloads |
2022 |
VLDB |
4.4901466e-05 |
| 8,917 |
DQDF: Data-Quality-Aware Dataframes |
2022 |
VLDB |
4.4229886e-05 |
| 9,911 |
ElasticNotebook: Enabling Live Migration for Computational Notebooks |
2024 |
VLDB |
4.2524493e-05 |
| 10,492 |
Fast and Scalable Data Transfer Across Data Systems |
2025 |
SIGMOD |
4.1905499e-05 |
| 10,599 |
Accio: Bolt-on Query Federation |
2025 |
VLDB |
4.1905499e-05 |
| 11,027 |
SplitDF: Splitting Dataframes for Memory-Efficient Data Analysis |
2024 |
VLDB |
4.1905499e-05 |
| 11,399 |
DPDS: Assisting Data Science with Data Provenance |
2022 |
VLDB |
4.1905499e-05 |
| 11,432 |
Leam: An Interactive System for In-situ Visual Text Analysis |
2021 |
CIDR |
4.1905499e-05 |
Outgoing Citations (Sorted by Pagerank)
Showing 24 of 24 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank |
Cited Paper |
Year |
Venue |
Pagerank |
| 14 |
Online Aggregation |
1997 |
SIGMOD |
0.0010813443 |
| 66 |
Spark SQL: Relational Data Processing in Spark |
2015 |
SIGMOD |
0.00061707583 |
| 112 |
Potter's Wheel: An Interactive Data Cleaning System |
2001 |
VLDB |
0.00047010908 |
| 179 |
Efficient and Extensible Algorithms for Multi Query Optimization |
2000 |
SIGMOD |
0.00037637319 |
| 185 |
DuckDB: an Embeddable Analytical Database |
2019 |
SIGMOD |
0.00036529607 |
| 515 |
QPipe: A Simultaneously Pipelined Relational Query Engine |
2005 |
SIGMOD |
0.00021209491 |
| 934 |
SharedDB: Killing One Thousand Queries With One Stone |
2012 |
VLDB |
0.00015201246 |
| 1,161 |
VerdictDB: Universalizing Approximate Query Processing |
2018 |
SIGMOD |
0.00013579831 |
| 1,205 |
PIVOT and UNPIVOT: Optimization and Execution Strategies in an RDBMS |
2004 |
VLDB |
0.00013309393 |
| 1,220 |
Rate-Based Query Optimization for Streaming Information Sources |
2002 |
SIGMOD |
0.00013214188 |
| 1,233 |
Maximizing the Output Rate of Multi-Way Join Queries over Streaming Information Sources |
2003 |
VLDB |
0.0001312635 |
| 1,384 |
Querying XML Views of Relational Data |
2001 |
VLDB |
0.00012259503 |
| 1,420 |
SchemaSQL - A Language for Interoperability in Relational Multi-database Systems |
1996 |
VLDB |
0.00012068815 |
| 1,666 |
HELIX: Holistic Optimization for Accelerating Iterative Machine Learning |
2019 |
VLDB |
0.00010955907 |
| 1,902 |
Hash joins and hash teams in Microsoft SQL Server |
1998 |
VLDB |
0.0001015225 |
| 2,005 |
Rapid Sampling for Visualizations with Ordering Guarantees |
2015 |
VLDB |
9.8168893e-05 |
| 2,100 |
Predictive Interaction for Data Transformation |
2015 |
CIDR |
9.5410186e-05 |
| 2,424 |
The Analytical Bootstrap: a New Method for Fast Error Estimation in Approximate Query Processing |
2014 |
SIGMOD |
8.8415494e-05 |
| 2,583 |
Sample + Seek: Approximating Aggregates with Distribution Precision Guarantee |
2016 |
SIGMOD |
8.4973431e-05 |
| 4,679 |
Adaptive Sampling for Rapidly Matching Histograms |
2018 |
VLDB |
5.9978792e-05 |
| 4,811 |
OQL: A Query Language for Manipulating Object-oriented Databases |
1989 |
VLDB |
5.900587e-05 |
| 5,674 |
Query Unnesting in Object-Oriented Databases |
1998 |
SIGMOD |
5.3787647e-05 |
| 6,503 |
DataSpread: Unifying Databases and Spreadsheets |
2015 |
VLDB |
5.0286698e-05 |
| 6,819 |
Skimmer: Rapid Scrolling of Relational Query Results |
2012 |
SIGMOD |
4.9105991e-05 |
Semantically Similar Papers
| Overall Rank |
Paper |
Year |
Venue |
Pagerank |
| 11,027 |
SplitDF: Splitting Dataframes for Memory-Efficient Data Analysis |
2024 |
VLDB |
4.1905499e-05 |
| 5,984 |
DataPrep.EDA: Task-Centric Exploratory Data Analysis for Statistical Modeling in Python |
2021 |
SIGMOD |
5.2400405e-05 |
| 4,006 |
Data Platform for Machine Learning |
2019 |
SIGMOD |
6.5371762e-05 |
| 11,290 |
To UDFs and Beyond: Demonstration of a Fully Decomposed Data Processor for General Data Wrangling Tasks |
2023 |
VLDB |
4.1905499e-05 |
| 2,955 |
Magpie: Python at Speed and Scale using Cloud Backends |
2021 |
CIDR |
7.8188583e-05 |
| 9,422 |
When sweet and cute isn't enough anymore: Solving scalability issues in Python Pandas with Grizzly |
2020 |
CIDR |
4.3399748e-05 |
| 4,813 |
Putting Pandas in a Box |
2021 |
CIDR |
5.8993009e-05 |
| 8,917 |
DQDF: Data-Quality-Aware Dataframes |
2022 |
VLDB |
4.4229886e-05 |
| 4,776 |
PolyFrame: A Retargetable Query-based Approach to Scaling Dataframes |
2021 |
VLDB |
5.9263134e-05 |
| 3,772 |
Flexible Rule-Based Decomposition and Metadata Independence in Modin: A Parallel Dataframe System |
2022 |
VLDB |
6.7736479e-05 |