DBScholar

Back to papers

An Architecture for Compiling UDF-centric Workflows

Summary: A compilation architecture for UDF-centric analytics workflows, jointly exploiting data, UDF, and hardware properties to generate specialized code. Implemented in Tupleware, it delivers up to 1000× speedups over existing systems. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
h7e3165f3de77278f
Venue
VLDB
Year
2015
Pagerank
0.00010628379
Overall Rank
1,445 | 90.29%
DOI
10.14778/2824032.2824045
PDF
Download (CC BY-NC-ND 3.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{crotty_vldb15,
        title = {{An Architecture for Compiling UDF-centric Workflows}},
        author = {Crotty, Andrew and Galakatos, Alex and Dursun, Kayhan and Kraska, Tim and Binnig, Carsten and Cetintemel, Ugur and Zdonik, Stan},
        journal = {PVLDB},
        series = {{VLDB} '15},
        volume = {8},
        number = {12},
        pages = {1466--1477},
        doi = {10.14778/2824032.2824045},
        url = {https://doi.org/10.14778/2824032.2824045},
        year = {2015}
}

Incoming Citations (Sorted by Pagerank)

Showing 33 of 33 citing papers.

Rank Citing Paper Year Venue Pagerank
40 The Case for Learned Index Structures 2018 SIGMOD 0.00046363107
416 SystemML: Declarative Machine Learning on Spark 2016 VLDB 0.00018650998
605 Everything You Always Wanted to Know About Compiled and Vectorized Queries But Were Afraid to Ask 2018 VLDB 0.00015640305
945 The End of Slow Networks: It's Time for a Redesign 2016 VLDB 0.00012933247
1,193 Weld: A Common Runtime for High Performance Data Analytics 2017 CIDR 0.00011582619
1,223 Data Management in Machine Learning: Challenges, Techniques, and Systems 2017 SIGMOD 0.00011468426
1,341 Relaxed Operator Fusion for In-Memory Databases: Making Compilation, Vectorization, and Prefetching Work Together At Last 2018 VLDB 0.00010963427
1,568 HELIX: Holistic Optimization for Accelerating Iterative Machine Learning 2019 VLDB 0.00010208225
1,797 IDEBench: A Benchmark for Interactive Data Exploration 2020 SIGMOD 9.6143465e-05
1,803 Tuplex: Data Science in Python at Native Code Speed 2021 SIGMOD 9.602292e-05
2,251 Evaluating End-to-End Optimization for Data Analytics Applications in Weld 2018 VLDB 8.750953e-05
2,420 How to Architect a Query Compiler, Revisited 2018 SIGMOD 8.4883426e-05
3,103 On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML 2018 VLDB 7.6456038e-05
3,331 SPOOF: Sum-Product Optimization and Operator Fusion for Large-Scale Machine Learning 2017 CIDR 7.4138851e-05
3,645 User-Defined Operators: Efficiently Integrating Custom Algorithms into Modern Databases 2022 VLDB 7.1383149e-05
3,651 Davos: A System for Interactive Data-Driven Decision Making 2021 VLDB 7.1336875e-05
3,739 In-RDBMS Hardware Acceleration of Advanced Analytics 2018 VLDB 7.0595382e-05
4,334 LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems 2021 SIGMOD 6.6537801e-05
5,234 Babelfish: Efficient Execution of Polyglot Queries 2022 VLDB 6.2159562e-05
5,772 Database Technology for the Masses: Sub-Operators as First-Class Entities 2021 VLDB 5.9964298e-05
5,930 Hillview: A trillion-cell spreadsheet for big data 2019 VLDB 5.9410245e-05
6,418 Containerized Execution of UDFs: An Experimental Evaluation 2022 VLDB 5.7899052e-05
7,455 Modularis: Modular Relational Analytics over Heterogeneous Distributed Platforms 2021 VLDB 5.5210654e-05
7,871 Building Advanced SQL Analytics From Low-Level Plan Operators 2021 SIGMOD 5.434014e-05
7,988 Efficient Execution of User-Defined Functions in SQL Queries 2023 VLDB 5.4105672e-05
8,171 Pangea: Monolithic Distributed Storage for Data Analytics 2019 VLDB 5.3826392e-05
8,381 Meta-Dataflows: Efficient Exploratory Dataflow Jobs 2018 SIGMOD 5.3411788e-05
8,681 Adaptive Code Generation for Data-Intensive Analytics 2021 VLDB 5.288863e-05
9,483 Query Compilation Without Regrets 2024 SIGMOD 5.1686727e-05
9,645 QURE: AI-Assisted and Automatically Verified UDF Inlining 2025 SIGMOD 5.1437878e-05
9,663 BladeDISC: Optimizing Dynamic Shape Machine Learning Workloads via Compiler Approach 2023 SIGMOD 5.142891e-05
10,052 Tuplex: Robust, Efficient Analytics When Python Rules 2019 VLDB 5.0890428e-05
11,803 To UDFs and Beyond: Demonstration of a Fully Decomposed Data Processor for General Data Wrangling Tasks 2023 VLDB 4.9769913e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 12 of 12 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Previous Page 1 / 1 Next

Semantically Similar Papers