DBScholar

Back to papers

To UDFs and Beyond: Demonstration of a Fully Decomposed Data Processor for General Data Wrangling Tasks

Summary: Fully decomposed, modular processor for semi-structured data enabling extensions into engine internals (indexes, I/O, aggregations) via plain Python—not just UDFs. Demo shows rapid prototyping to embed ML libraries/pretrained models into query pipelines (e.g., tweet sentiment) for customizable data‑wrangling. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID
h6556e5079e93521a
Venue
VLDB
Year
2023
Pagerank
4.9605343e-05
Overall Rank
11,847 | 20.59%
DOI
10.14778/3611540.3611610
PDF
Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

BibTeX Citation

@article{schafer_vldb23,
        title = {{To UDFs and Beyond: Demonstration of a Fully Decomposed Data Processor for General Data Wrangling Tasks}},
        author = {Schäfer, Nico and Gjurovski, Damjan and Davitkova, Angjela and Michel, Sebastian},
        journal = {PVLDB},
        series = {{VLDB} '23},
        volume = {16},
        number = {12},
        pages = {4018--4021},
        doi = {10.14778/3611540.3611610},
        url = {https://doi.org/10.14778/3611540.3611610},
        year = {2023}
}

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank Citing Paper Year Venue Pagerank
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 9 of 9 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
105 The MADlib Analytics Library or MAD Skills, the SQL 2012 VLDB 0.00033605348
1,289 SQL/MapReduce: A practical approach to self-describing, polymorphic, and parallelizable user-defined functions 2009 VLDB 0.0001116552
1,449 An Architecture for Compiling UDF-centric Workflows 2015 VLDB 0.00010597074
1,616 SystemDS: A Declarative Machine Learning System for the End-to-End Data Science Lifecycle 2020 CIDR 0.00010048776
1,800 Procedural Extensions of SQL: Understanding their usage in the wild 2021 VLDB 9.5999908e-05
1,812 Tuplex: Data Science in Python at Native Code Speed 2021 SIGMOD 9.5747668e-05
2,716 Compiling PL/SQL Away 2020 CIDR 8.0819509e-05
3,190 One WITH RECURSIVE is Worth Many GOTOs 2021 SIGMOD 7.5364422e-05
3,654 User-Defined Operators: Efficiently Integrating Custom Algorithms into Modern Databases 2022 VLDB 7.1147757e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 11,778 Udon: Efficient Debugging of User-Defined Functions in Big Data Systems with Line-by-Line Control 2023 SIGMOD
2 8,002 Efficient Execution of User-Defined Functions in SQL Queries 2023 VLDB
3 10,021 One-pass Data Mining Algorithms in a DBMS with UDFs 2011 SIGMOD
4 3,654 User-Defined Operators: Efficiently Integrating Custom Algorithms into Modern Databases 2022 VLDB
5 12,430 Synthesizing Data Programs 2015 CIDR
6 1,226 Data Management in Machine Learning: Challenges, Techniques, and Systems 2017 SIGMOD
7 7,379 The VADA Architecture for Cost-Effective Data Wrangling 2017 SIGMOD
8 9,964 Unified Data Analytics: State-of-the-art and Open Problems 2022 VLDB
9 1,449 An Architecture for Compiling UDF-centric Workflows 2015 VLDB
10 3,397 Putting Pandas in a Box 2021 CIDR