Efficient Execution of User-Defined Functions in SQL Queries

Summary: Tutorial on bridging the execution-model mismatch between SQL engines and UDFs. Surveys physical optimization and compilation techniques, compares recent systems, and highlights open gaps and research directions for analytics/ML workloads. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: h9bf4cfbcf6296c68
Venue: VLDB
Year: 2023
Pagerank: 5.4131297e-05
Overall Rank: 7,983 | 46.33%
DOI: 10.14778/3611540.3611574

Incoming Non-self Citations Over Time

Authors

1. Yannis Foufoulas (Athena Research Center; University of Athens)
2. Alkis Simitsis (Athena Research Center)

BibTeX Citation

@article{foufoulas_vldb23,
        title = {{Efficient Execution of User-Defined Functions in SQL Queries}},
        author = {Foufoulas, Yannis and Simitsis, Alkis},
        journal = {PVLDB},
        series = {{VLDB} '23},
        volume = {16},
        number = {12},
        pages = {3874--3877},
        doi = {10.14778/3611540.3611574},
        url = {https://doi.org/10.14778/3611540.3611574},
        year = {2023}
}

Incoming Citations (Sorted by Pagerank)

Showing 7 of 7 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
6,742	Mitigating the Impedance Mismatch between Prediction Query Execution and Database Engine	2025	SIGMOD	5.6910432e-05
9,458	HyperBlocker: Accelerating Rule-based Blocking in Entity Resolution using GPUs	2025	VLDB	5.173446e-05
9,694	The UDFBench Benchmark for General-purpose UDF Queries	2025	VLDB	5.1396592e-05
10,448	EncoderForge: Generating Efficient SQL for Encoders in Machine Learning Inference Pipelines	2026	SIGMOD	4.9793485e-05
10,832	ReSequel: Robust LLM-assisted Query Rewriting and Optimization using Templatization and Sampling	2026	VLDB	4.9793485e-05
11,168	UDFBench: A Tool for Benchmarking UDF Queries on SQL Engines	2025	SIGMOD	4.9793485e-05
11,177	Approximating Opaque Top-k Queries	2025	SIGMOD	4.9793485e-05

Outgoing Citations (Sorted by Pagerank)

Showing 23 of 23 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
605	Everything You Always Wanted to Know About Compiled and Vectorized Queries But Were Afraid to Ask	2018	VLDB	0.00015647561
896	Froid: Optimization of Imperative Programs in a Relational Database	2018	VLDB	0.00013209291
1,193	Weld: A Common Runtime for High Performance Data Analytics	2017	CIDR	0.0001158809
1,444	An Architecture for Compiling UDF-centric Workflows	2015	VLDB	0.0001063181
1,803	Tuplex: Data Science in Python at Native Code Speed	2021	SIGMOD	9.6068397e-05
2,182	Extending Relational Query Processing with ML Inference	2020	CIDR	8.8982998e-05
2,207	Magpie: Python at Speed and Scale using Cloud Backends	2021	CIDR	8.8487039e-05
2,249	Evaluating End-to-End Optimization for Data Analytics Applications in Weld	2018	VLDB	8.7549752e-05
2,705	Compiling PL/SQL Away	2020	CIDR	8.1111408e-05
2,778	AIDA - Abstraction for Advanced In-Database Analytics	2018	VLDB	8.0299506e-05
2,993	Extracting Equivalent SQL from Imperative Code in Database Applications	2016	SIGMOD	7.7721951e-05
3,101	On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML	2018	VLDB	7.649219e-05
3,384	Putting Pandas in a Box	2021	CIDR	7.3550055e-05
3,642	User-Defined Operators: Efficiently Integrating Custom Algorithms into Modern Databases	2022	VLDB	7.1416697e-05
4,061	Aggify: Lifting the Curse of Cursor Loops using Custom Aggregates	2020	SIGMOD	6.824809e-05
5,230	Babelfish: Efficient Execution of Polyglot Queries	2022	VLDB	6.2189001e-05
5,719	Accelerating Python UDFs in Vectorized Query Execution	2022	CIDR	6.0187779e-05
5,809	Snakes on a Plan: Compiling Python Functions into Plain SQL Queries	2022	SIGMOD	5.987479e-05
6,212	YeSQL: "You extend SQL" with Rich and Highly Performant User-Defined Functions in Relational Databases	2022	VLDB	5.8480745e-05
6,400	Functional-Style SQL UDFs With a Capital 'F'	2020	SIGMOD	5.7981078e-05
6,707	Machine Learning, Linear Algebra, and More: Is SQL All You Need?	2022	CIDR	5.7038956e-05
8,822	Boosting Efficiency of External Pipelines by Blurring Application Boundaries	2022	CIDR	5.2690274e-05
13,914	BabbleFlow - A Translator for Analytic Data Flow Programs	2014	SIGMOD	-

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	5,012	User-Defined Aggregate Functions: Bridging Theory and Practice	2006	SIGMOD
2	12,800	Fast and Dynamic OLAP Exploration Using UDFs	2009	SIGMOD
3	1,444	An Architecture for Compiling UDF-centric Workflows	2015	VLDB
4	6,085	Dear User-Defined Functions, Inlining isn't working out so great for us. Let's try batching to make our relationship work. Sincerely, SQL	2024	CIDR
5	3,642	User-Defined Operators: Efficiently Integrating Custom Algorithms into Modern Databases	2022	VLDB
6	3,988	Exploiting Correlations for Expensive Predicate Evaluation	2015	SIGMOD
7	11,168	UDFBench: A Tool for Benchmarking UDF Queries on SQL Engines	2025	SIGMOD
8	5,719	Accelerating Python UDFs in Vectorized Query Execution	2022	CIDR
9	6,400	Functional-Style SQL UDFs With a Capital 'F'	2020	SIGMOD
10	9,694	The UDFBench Benchmark for General-purpose UDF Queries	2025	VLDB