Putting Pandas in a Box

Summary: Transpiles Pandas scripts into DBMS-executable SQL, pushing core DataFrame ops and external file access into the database. Automatically converts Python UDFs to SQL UDFs to run complex computations in-DB (e.g., model-join for scoring pre-trained ML models). (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: h4bb3433c706a1af8
Venue: CIDR
Year: 2021
Pagerank: 7.3550055e-05
Overall Rank: 3,384 | 77.25%
DOI: -

Incoming Non-self Citations Over Time

Authors

1. Stefan Hagedorn (Ilmenau University of Technology)
2. Steffen Kläbe (Ilmenau University of Technology)
3. Kai-Uwe Sattler (Ilmenau University of Technology)

BibTeX Citation

@inproceedings{hagedorn_cidr21,
        address = {Amsterdam, Netherlands},
        series = {{CIDR} '21},
        title = {{Putting Pandas in a Box}},
        booktitle = {Proceedings of the {Conference} on {Innovative} {Data} {Systems} {Research}},
        author = {Hagedorn, Stefan and Kläbe, Steffen and Sattler, Kai-Uwe},
        year = {2021}
}

Incoming Citations (Sorted by Pagerank)

Showing 12 of 12 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
4,815	PolyFrame: A Retargetable Query-based Approach to Scaling Dataframes	2021	VLDB	6.3992929e-05
5,230	Babelfish: Efficient Execution of Polyglot Queries	2022	VLDB	6.2189001e-05
6,116	ConnectorX: Accelerating Data Loading From Databases to Dataframes	2022	VLDB	5.8815309e-05
6,212	YeSQL: "You extend SQL" with Rich and Highly Performant User-Defined Functions in Relational Databases	2022	VLDB	5.8480745e-05
6,415	Containerized Execution of UDFs: An Experimental Evaluation	2022	VLDB	5.7926473e-05
7,983	Efficient Execution of User-Defined Functions in SQL Queries	2023	VLDB	5.4131297e-05
9,637	QURE: AI-Assisted and Automatically Verified UDF Inlining	2025	SIGMOD	5.1462239e-05
9,694	The UDFBench Benchmark for General-purpose UDF Queries	2025	VLDB	5.1396592e-05
10,448	EncoderForge: Generating Efficient SQL for Encoders in Machine Learning Inference Pipelines	2026	SIGMOD	4.9793485e-05
10,898	stratum: A System Infrastructure for Massive Agent-Centric ML Workloads	2026	VLDB	4.9793485e-05
10,995	Painless and Efficient Scaling of Pandas Programs: Demo	2026	VLDB	4.9793485e-05
11,177	Approximating Opaque Top-k Queries	2025	SIGMOD	4.9793485e-05

Outgoing Citations (Sorted by Pagerank)

Showing 3 of 3 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
1,044	RIOT: I/O-Efficient Numerical Computing without SQL	2009	CIDR	0.00012332595
2,778	AIDA - Abstraction for Advanced In-Database Analytics	2018	VLDB	8.0299506e-05
9,743	When sweet and cute isn't enough anymore: Solving scalability issues in Python Pandas with Grizzly	2020	CIDR	5.1349531e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	4,815	PolyFrame: A Retargetable Query-based Approach to Scaling Dataframes	2021	VLDB
2	9,989	One-pass Data Mining Algorithms in a DBMS with UDFs	2011	SIGMOD
3	11,791	Demonstration of OpenDBML, a Framework for Democratizing In-Database Machine Learning	2023	VLDB
4	5,719	Accelerating Python UDFs in Vectorized Query Execution	2022	CIDR
5	2,207	Magpie: Python at Speed and Scale using Cloud Backends	2021	CIDR
6	10,995	Painless and Efficient Scaling of Pandas Programs: Demo	2026	VLDB
7	1,369	Towards Scalable Dataframe Systems	2020	VLDB
8	11,647	PD-Explain: A Unified Python-native Framework for Query Explanations Over DataFrames	2024	VLDB
9	11,797	To UDFs and Beyond: Demonstration of a Fully Decomposed Data Processor for General Data Wrangling Tasks	2023	VLDB
10	9,743	When sweet and cute isn't enough anymore: Solving scalability issues in Python Pandas with Grizzly	2020	CIDR