Efficient Execution of User-Defined Functions in SQL Queries

Summary: Tutorial on bridging the execution-model mismatch between SQL engines and UDFs. Surveys physical optimization and compilation techniques, compares recent systems, and highlights open gaps and research directions for analytics/ML workloads. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: h9bf4cfbcf6296c68
Venue: VLDB
Year: 2023
Pagerank: 5.3927693e-05
Overall Rank: 8,002 | 46.37%
DOI: 10.14778/3611540.3611574
PDF: Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

1. Yannis Foufoulas (Athena Research Center; University of Athens)
2. Alkis Simitsis (Athena Research Center)

BibTeX Citation

@article{foufoulas_vldb23,
        title = {{Efficient Execution of User-Defined Functions in SQL Queries}},
        author = {Foufoulas, Yannis and Simitsis, Alkis},
        journal = {PVLDB},
        series = {{VLDB} '23},
        volume = {16},
        number = {12},
        pages = {3874--3877},
        doi = {10.14778/3611540.3611574},
        url = {https://doi.org/10.14778/3611540.3611574},
        year = {2023}
}

Incoming Citations (Sorted by Pagerank)

Showing 7 of 7 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
6,765	Mitigating the Impedance Mismatch between Prediction Query Execution and Database Engine	2025	SIGMOD	5.6695399e-05
9,475	HyperBlocker: Accelerating Rule-based Blocking in Entity Resolution using GPUs	2025	VLDB	5.157794e-05
9,729	The UDFBench Benchmark for General-purpose UDF Queries	2025	VLDB	5.1202393e-05
10,525	EncoderForge: Generating Efficient SQL for Encoders in Machine Learning Inference Pipelines	2026	SIGMOD	4.9605343e-05
10,903	ReSequel: Robust LLM-assisted Query Rewriting and Optimization using Templatization and Sampling	2026	VLDB	4.9605343e-05
11,236	UDFBench: A Tool for Benchmarking UDF Queries on SQL Engines	2025	SIGMOD	4.9605343e-05
11,245	Approximating Opaque Top-k Queries	2025	SIGMOD	4.9605343e-05

Outgoing Citations (Sorted by Pagerank)

Showing 23 of 23 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
606	Everything You Always Wanted to Know About Compiled and Vectorized Queries But Were Afraid to Ask	2018	VLDB	0.00015609823
896	Froid: Optimization of Imperative Programs in a Relational Database	2018	VLDB	0.00013164545
1,197	Weld: A Common Runtime for High Performance Data Analytics	2017	CIDR	0.00011548039
1,449	An Architecture for Compiling UDF-centric Workflows	2015	VLDB	0.00010597074
1,812	Tuplex: Data Science in Python at Native Code Speed	2021	SIGMOD	9.5747668e-05
2,199	Extending Relational Query Processing with ML Inference	2020	CIDR	8.8664379e-05
2,219	Magpie: Python at Speed and Scale using Cloud Backends	2021	CIDR	8.8186113e-05
2,258	Evaluating End-to-End Optimization for Data Analytics Applications in Weld	2018	VLDB	8.7387151e-05
2,716	Compiling PL/SQL Away	2020	CIDR	8.0819509e-05
2,783	AIDA - Abstraction for Advanced In-Database Analytics	2018	VLDB	8.0027405e-05
3,002	Extracting Equivalent SQL from Imperative Code in Database Applications	2016	SIGMOD	7.7473824e-05
3,104	On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML	2018	VLDB	7.6281929e-05
3,397	Putting Pandas in a Box	2021	CIDR	7.3273688e-05
3,654	User-Defined Operators: Efficiently Integrating Custom Algorithms into Modern Databases	2022	VLDB	7.1147757e-05
4,078	Aggify: Lifting the Curse of Cursor Loops using Custom Aggregates	2020	SIGMOD	6.8028789e-05
5,246	Babelfish: Efficient Execution of Polyglot Queries	2022	VLDB	6.1985833e-05
5,723	Accelerating Python UDFs in Vectorized Query Execution	2022	CIDR	5.9993122e-05
5,792	Snakes on a Plan: Compiling Python Functions into Plain SQL Queries	2022	SIGMOD	5.9761316e-05
6,218	YeSQL: "You extend SQL" with Rich and Highly Performant User-Defined Functions in Relational Databases	2022	VLDB	5.8292066e-05
6,413	Functional-Style SQL UDFs With a Capital 'F'	2020	SIGMOD	5.7764365e-05
6,726	Machine Learning, Linear Algebra, and More: Is SQL All You Need?	2022	CIDR	5.6824602e-05
8,849	Boosting Efficiency of External Pipelines by Blurring Application Boundaries	2022	CIDR	5.2492156e-05
13,959	BabbleFlow - A Translator for Analytic Data Flow Programs	2014	SIGMOD	-

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	5,028	User-Defined Aggregate Functions: Bridging Theory and Practice	2006	SIGMOD
2	12,849	Fast and Dynamic OLAP Exploration Using UDFs	2009	SIGMOD
3	1,449	An Architecture for Compiling UDF-centric Workflows	2015	VLDB
4	6,100	Dear User-Defined Functions, Inlining isn't working out so great for us. Let's try batching to make our relationship work. Sincerely, SQL	2024	CIDR
5	3,654	User-Defined Operators: Efficiently Integrating Custom Algorithms into Modern Databases	2022	VLDB
6	4,000	Exploiting Correlations for Expensive Predicate Evaluation	2015	SIGMOD
7	11,236	UDFBench: A Tool for Benchmarking UDF Queries on SQL Engines	2025	SIGMOD
8	5,723	Accelerating Python UDFs in Vectorized Query Execution	2022	CIDR
9	6,413	Functional-Style SQL UDFs With a Capital 'F'	2020	SIGMOD
10	9,729	The UDFBench Benchmark for General-purpose UDF Queries	2025	VLDB