DBScholar

Back to papers

Towards Scalable Dataframe Systems

Summary: Scalable dataframe systems via MODIN; scaling pandas-like APIs with a simple dataframe data model and algebra. Signature features: flexible schemas, ordering, row/column equivalence, data/metadata fluidity; a trial-and-error interaction model spurs open data-management research. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
12285
Venue
VLDB
Year
2020
Pagerank
0.00010807221
Overall Rank
1,431 | 90.19%
DOI
10.14778/3407790.3407807

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{petersohn_vldb20,
        title = {{Towards Scalable Dataframe Systems}},
        author = {Petersohn, Devin and Macke, Stephen and Xin, Doris and Ma, William and Lee, Doris and Mo, Xiangxi and Gonzalez, Joseph E. and Hellerstein, Joseph M. and Joseph, Anthony D. and Parameswaran, Aditya},
        journal = {PVLDB},
        series = {{VLDB} '20},
        volume = {13},
        number = {11},
        pages = {2033--2046},
        doi = {10.14778/3407790.3407807},
        url = {https://doi.org/10.14778/3407790.3407807},
        year = {2020}
}

Incoming Citations (Sorted by Pagerank)

Showing 21 of 21 citing papers.

Rank Citing Paper Year Venue Pagerank
1,241 Balsa: Learning a Query Optimizer Without Expert Demonstrations 2022 SIGMOD 0.00011521639
2,651 Magpie: Python at Speed and Scale using Cloud Backends 2021 CIDR 8.2918086e-05
2,823 Query Processing on Tensor Computation Runtimes 2022 VLDB 8.0893814e-05
3,072 Lux: Always-on Visualization Recommendations for Exploratory Dataframe Workflows 2022 VLDB 7.7873864e-05
3,582 The Composable Data Management System Manifesto 2023 VLDB 7.2869486e-05
4,079 Flexible Rule-Based Decomposition and Metadata Independence in Modin: A Parallel Dataframe System 2022 VLDB 6.9188052e-05
4,728 PolyFrame: A Retargetable Query-based Approach to Scaling Dataframes 2021 VLDB 6.5360246e-05
4,796 A Critique of Modern SQL And A Proposal Towards A Simple and Expressive Query Language 2024 CIDR 6.5031952e-05
5,620 DataPrep.EDA: Task-Centric Exploratory Data Analysis for Statistical Modeling in Python 2021 SIGMOD 6.1482864e-05
6,538 UPLIFT: Parallelization Strategies for Feature Transformations in Machine Learning Workloads 2022 VLDB 5.8477764e-05
6,628 ConnectorX: Accelerating Data Loading From Databases to Dataframes 2022 VLDB 5.8197537e-05
7,395 Automating and Optimizing Data-Centric What-If Analyses on Native Machine Learning Pipelines 2023 SIGMOD 5.6257796e-05
7,502 Decentralized Actor Scheduling and Reference-based Storage in Xorbits: a Native Scalable Data Science Engine 2025 VLDB 5.6029996e-05
8,050 Capturing and Querying Fine-grained Provenance of Preprocessing Pipelines in Data Science 2021 VLDB 5.5000099e-05
9,069 DQDF: Data-Quality-Aware Dataframes 2022 VLDB 5.3251649e-05
10,075 ElasticNotebook: Enabling Live Migration for Computational Notebooks 2024 VLDB 5.1613298e-05
10,761 Fast and Scalable Data Transfer Across Data Systems 2025 SIGMOD 5.093636e-05
10,852 Accio: Bolt-on Query Federation 2025 VLDB 5.093636e-05
11,235 SplitDF: Splitting Dataframes for Memory-Efficient Data Analysis 2024 VLDB 5.093636e-05
11,594 DPDS: Assisting Data Science with Data Provenance 2022 VLDB 5.093636e-05
11,627 Leam: An Interactive System for In-situ Visual Text Analysis 2021 CIDR 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 24 of 24 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
9 Online Aggregation 1997 SIGMOD 0.00077458002
24 Spark SQL: Relational Data Processing in Spark 2015 SIGMOD 0.00054865648
94 Potter's Wheel: An Interactive Data Cleaning System 2001 VLDB 0.00034616103
103 DuckDB: an Embeddable Analytical Database 2019 SIGMOD 0.00034161428
128 Efficient and Extensible Algorithms for Multi Query Optimization 2000 SIGMOD 0.0003072825
383 QPipe: A Simultaneously Pipelined Relational Query Engine 2005 SIGMOD 0.00019520728
670 SharedDB: Killing One Thousand Queries With One Stone 2012 VLDB 0.00015157572
772 VerdictDB: Universalizing Approximate Query Processing 2018 SIGMOD 0.00014147905
1,016 Rate-Based Query Optimization for Streaming Information Sources 2002 SIGMOD 0.00012645699
1,093 Maximizing the Output Rate of Multi-Way Join Queries over Streaming Information Sources 2003 VLDB 0.00012218435
1,243 Querying XML Views of Relational Data 2001 VLDB 0.00011513177
1,558 SchemaSQL - A Language for Interoperability in Relational Multi-database Systems 1996 VLDB 0.00010366362
1,569 HELIX: Holistic Optimization for Accelerating Iterative Machine Learning 2019 VLDB 0.00010335423
1,634 Rapid Sampling for Visualizations with Ordering Guarantees 2015 VLDB 0.00010163938
1,691 PIVOT and UNPIVOT: Optimization and Execution Strategies in an RDBMS 2004 VLDB 9.9999141e-05
1,809 Hash joins and hash teams in Microsoft SQL Server 1998 VLDB 9.7034998e-05
1,866 Predictive Interaction for Data Transformation 2015 CIDR 9.5914583e-05
1,872 The Analytical Bootstrap: a New Method for Fast Error Estimation in Approximate Query Processing 2014 SIGMOD 9.5759874e-05
1,962 Sample + Seek: Approximating Aggregates with Distribution Precision Guarantee 2016 SIGMOD 9.3978414e-05
4,828 CQL: A Query Language for Manipulating Object-oriented Databases 1989 VLDB 6.4892476e-05
4,926 Adaptive Sampling for Rapidly Matching Histograms 2018 VLDB 6.4428362e-05
5,951 Query Unnesting in Object-Oriented Databases 1998 SIGMOD 6.0313489e-05
6,395 DataSpread: Unifying Databases and Spreadsheets 2015 VLDB 5.8876003e-05
6,893 Skimmer: Rapid Scrolling of Relational Query Results 2012 SIGMOD 5.7446791e-05
Previous Page 1 / 1 Next

Semantically Similar Papers