DBScholar

Back to papers

An Architecture for Compiling UDF-centric Workflows

Summary: A compilation architecture for UDF-centric analytics workflows, jointly exploiting data, UDF, and hardware properties to generate specialized code. Implemented in Tupleware, it delivers up to 1000× speedups over existing systems. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
11212
Venue
VLDB
Year
2015
Pagerank
0.00010778486
Overall Rank
1,442 | 90.11%
DOI
10.14778/2824032.2824045

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{crotty_vldb15,
        title = {{An Architecture for Compiling UDF-centric Workflows}},
        author = {Crotty, Andrew and Galakatos, Alex and Dursun, Kayhan and Kraska, Tim and Binnig, Carsten and Cetintemel, Ugur and Zdonik, Stan},
        journal = {PVLDB},
        series = {{VLDB} '15},
        volume = {8},
        number = {12},
        pages = {1466--1477},
        doi = {10.14778/2824032.2824045},
        url = {https://doi.org/10.14778/2824032.2824045},
        year = {2015}
}

Incoming Citations (Sorted by Pagerank)

Showing 33 of 33 citing papers.

Rank Citing Paper Year Venue Pagerank
43 The Case for Learned Index Structures 2018 SIGMOD 0.00046060254
415 SystemML: Declarative Machine Learning on Spark 2016 VLDB 0.0001888524
649 Everything You Always Wanted to Know About Compiled and Vectorized Queries But Were Afraid to Ask 2018 VLDB 0.00015320656
976 The End of Slow Networks: It's Time for a Redesign 2016 VLDB 0.00012864533
1,229 Weld: A Common Runtime for High Performance Data Analytics 2017 CIDR 0.00011578425
1,250 Data Management in Machine Learning: Challenges, Techniques, and Systems 2017 SIGMOD 0.00011485301
1,379 Relaxed Operator Fusion for In-Memory Databases: Making Compilation, Vectorization, and Prefetching Work Together At Last 2018 VLDB 0.00010970894
1,569 HELIX: Holistic Optimization for Accelerating Iterative Machine Learning 2019 VLDB 0.00010335423
1,767 IDEBench: A Benchmark for Interactive Data Exploration 2020 SIGMOD 9.805856e-05
1,768 Tuplex: Data Science in Python at Native Code Speed 2021 SIGMOD 9.8041636e-05
2,316 Evaluating End-to-End Optimization for Data Analytics Applications in Weld 2018 VLDB 8.7596739e-05
2,488 How to Architect a Query Compiler, Revisited 2018 SIGMOD 8.5091578e-05
3,205 On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML 2018 VLDB 7.6386536e-05
3,284 SPOOF: Sum-Product Optimization and Operator Fusion for Large-Scale Machine Learning 2017 CIDR 7.5663058e-05
3,570 Davos: A System for Interactive Data-Driven Decision Making 2021 VLDB 7.3008782e-05
3,682 In-RDBMS Hardware Acceleration of Advanced Analytics 2018 VLDB 7.2035518e-05
4,240 LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems 2021 SIGMOD 6.809685e-05
4,273 User-Defined Operators: Efficiently Integrating Custom Algorithms into Modern Databases 2022 VLDB 6.7909197e-05
5,301 Babelfish: Efficient Execution of Polyglot Queries 2022 VLDB 6.2750553e-05
6,028 Hillview: A trillion-cell spreadsheet for big data 2019 VLDB 6.0019322e-05
6,263 Database Technology for the Masses: Sub-Operators as First-Class Entities 2021 VLDB 5.936052e-05
6,553 Containerized Execution of UDFs: An Experimental Evaluation 2022 VLDB 5.8417517e-05
7,774 Building Advanced SQL Analytics From Low-Level Plan Operators 2021 SIGMOD 5.5468469e-05
7,899 Modularis: Modular Relational Analytics over Heterogeneous Distributed Platforms 2021 VLDB 5.5195553e-05
8,001 Pangea: Monolithic Distributed Storage for Data Analytics 2019 VLDB 5.508791e-05
8,096 Efficient Execution of User-Defined Functions in SQL Queries 2023 VLDB 5.4875738e-05
8,237 Meta-Dataflows: Efficient Exploratory Dataflow Jobs 2018 SIGMOD 5.4601966e-05
8,636 Adaptive Code Generation for Data-Intensive Analytics 2021 VLDB 5.3954959e-05
9,456 QURE: AI-Assisted and Automatically Verified UDF Inlining 2025 SIGMOD 5.2643416e-05
9,475 BladeDISC: Optimizing Dynamic Shape Machine Learning Workloads via Compiler Approach 2023 SIGMOD 5.2634238e-05
9,856 Tuplex: Robust, Efficient Analytics When Python Rules 2019 VLDB 5.2082931e-05
10,072 Query Compilation Without Regrets 2024 SIGMOD 5.1624689e-05
11,487 To UDFs and Beyond: Demonstration of a Fully Decomposed Data Processor for General Data Wrangling Tasks 2023 VLDB 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 12 of 12 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
23 Efficiently Compiling Efficient Query Plans for Modern Hardware 2011 VLDB 0.00054886415
30 SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets 2008 VLDB 0.00051174276
372 HaLoop: Efficient Iterative Data Processing on Large Clusters 2010 VLDB 0.0001981521
534 Building Efficient Query Engines in a High-Level Language 2014 VLDB 0.00017046514
771 Conjunctive Selection Conditions in Main Memory 2002 PODS 0.00014161995
872 Tenzing: A SQL Implementation On The MapReduce Framework 2011 VLDB 0.00013486409
1,054 Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads 2012 VLDB 0.00012390673
1,150 DimmWitted: A Study of Main-Memory Statistical Analytics 2014 VLDB 0.00011943462
3,195 Micro Adaptivity in Vectorwise 2013 SIGMOD 7.6481177e-05
4,778 ASTERIX: An Open Source System for "Big Data" Management and Analysis (Demo) 2012 VLDB 6.5133529e-05
5,189 Performance Analysis of a Relational Data Base Management System 1979 SIGMOD 6.3272576e-05
6,736 Hadoop's Adolescence: An analysis of Hadoop usage in scientific workloads 2013 VLDB 5.787547e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 1,797 How to Architect a Query Compiler 2016 SIGMOD
2 11,487 To UDFs and Beyond: Demonstration of a Fully Decomposed Data Processor for General Data Wrangling Tasks 2023 VLDB
3 1,768 Tuplex: Data Science in Python at Native Code Speed 2021 SIGMOD
4 6,253 Declarative Sub-Operators for Universal Data Processing 2023 VLDB
5 10,740 UDFBench: A Tool for Benchmarking UDF Queries on SQL Engines 2025 SIGMOD
6 6,328 Functional-Style SQL UDFs With a Capital 'F' 2020 SIGMOD
7 9,917 The UDFBench Benchmark for General-purpose UDF Queries 2025 VLDB
8 5,791 Accelerating Python UDFs in Vectorized Query Execution 2022 CIDR
9 2,094 Tupleware: "Big" Data, Big Analytics, Small Clusters 2015 CIDR
10 8,096 Efficient Execution of User-Defined Functions in SQL Queries 2023 VLDB