Flexible Rule-Based Decomposition and Metadata Independence in Modin: A Parallel Dataframe System

Summary: Modin translates pandas functions into a core operator set, parallelized with columnar, row-wise, and cell-wise decomposition rules. Metadata independence decouples order and type from physical layout, enabling lazy maintenance and true cross-operator row/column pandas support on large dataframes, outperforming pandas and Koalas/Dask. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 12946
Venue: VLDB
Year: 2022
Pagerank: 6.7801795e-05
Overall Rank: 3,763 | 73.83%
DOI: 10.14778/3494124.3494152

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 5 of 5 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
5,307	A Critique of Modern SQL And A Proposal Towards A Simple and Expressive Query Language	2024	CIDR	5.5766594e-05
6,895	Decentralized Actor Scheduling and Reference-based Storage in Xorbits: a Native Scalable Data Science Engine	2025	VLDB	4.8925595e-05
8,514	UPLIFT: Parallelization Strategies for Feature Transformations in Machine Learning Workloads	2022	VLDB	4.4944285e-05
9,762	QURE: AI-Assisted and Automatically Verified UDF Inlining	2025	SIGMOD	4.2856106e-05
9,911	Dias: Dynamic Rewriting of Pandas Code	2024	SIGMOD	4.2565279e-05

Outgoing Citations (Sorted by Pagerank)

Showing 16 of 16 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
35	MonetDB/X100: Hyper-Pipelining Query Execution	2005	CIDR	0.00076197749
66	Spark SQL: Relational Data Processing in Spark	2015	SIGMOD	0.00061639801
109	Dremel: Interactive Analysis of Web-Scale Datasets	2010	VLDB	0.00048186983
157	HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads	2009	VLDB	0.00040397359
167	The Snowflake Elastic Data Warehouse	2016	SIGMOD	0.00039180521
318	Overview of SciDB: Large Scale Array Storage, Processing and Analysis	2010	SIGMOD	0.00027795661
426	Amazon Redshift and the Case for Simpler Data Warehouses	2015	SIGMOD	0.00023594359
476	Impala: A Modern, Open-Source SQL Engine for Hadoop	2015	CIDR	0.00022226941
734	The TileDB Array Data Storage Manager	2017	VLDB	0.00017455248
1,076	RIOT: I/O-Efficient Numerical Computing without SQL	2009	CIDR	0.00014248449
1,427	Towards Scalable Dataframe Systems	2020	VLDB	0.0001204248
1,876	ArrayStore: A Storage Manager for Complex Parallel Array Processing	2011	SIGMOD	0.00010239284
2,062	Dremel: A Decade of Interactive SQL Analysis at Web Scale	2020	VLDB	9.6481955e-05
2,545	POLARIS: The Distributed SQL Engine in Azure Synapse	2020	VLDB	8.5725413e-05
2,934	AIDA - Abstraction for Advanced In-Database Analytics	2018	VLDB	7.8595778e-05
2,954	Magpie: Python at Speed and Scale using Cloud Backends	2021	CIDR	7.8262582e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
9,911	Dias: Dynamic Rewriting of Pandas Code	2024	SIGMOD	4.2565279e-05
2,848	Exploiting Matrix Dependency for Efficient Distributed Matrix Computation	2015	SIGMOD	8.0208832e-05
4,813	Putting Pandas in a Box	2021	CIDR	5.9049746e-05
8,078	Meta-Dataflows: Efficient Exploratory Dataflow Jobs	2018	SIGMOD	4.5914967e-05
1,750	Weld: A Common Runtime for High Performance Data Analytics	2017	CIDR	0.00010683647
8,915	DQDF: Data-Quality-Aware Dataframes	2022	VLDB	4.427232e-05
11,024	SplitDF: Splitting Dataframes for Memory-Efficient Data Analysis	2024	VLDB	4.1945683e-05
4,773	PolyFrame: A Retargetable Query-based Approach to Scaling Dataframes	2021	VLDB	5.9320139e-05
8,094	Modularis: Modular Relational Analytics over Heterogeneous Distributed Platforms	2021	VLDB	4.5867812e-05
1,427	Towards Scalable Dataframe Systems	2020	VLDB	0.0001204248