An Architecture for Compiling UDF-centric Workflows

Summary: An architecture to automatically compile UDF-centric workflows for complex analytics, targeting computation bottlenecks. Data/UDF/hardware-aware optimizations produce per-workflow code in TUPLEWARE, achieving up to three orders of magnitude speedups against alternatives. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 11024
Venue: VLDB
Year: 2015
Pagerank: 0.00010253002
Overall Rank: 1,873 | 86.98%
DOI: -

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 33 of 33 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
102	The Case for Learned Index Structures	2018	SIGMOD	0.00049545203
557	SystemML: Declarative Machine Learning on Spark	2016	VLDB	0.00020197988
853	Everything You Always Wanted to Know About Compiled and Vectorized Queries But Were Afraid to Ask	2018	VLDB	0.00015940507
1,361	The End of Slow Networks: It's Time for a Redesign	2016	VLDB	0.00012379741
1,532	Data Management in Machine Learning: Challenges, Techniques, and Systems	2017	SIGMOD	0.00011472681
1,666	HELIX: Holistic Optimization for Accelerating Iterative Machine Learning	2019	VLDB	0.0001096361
1,750	Weld: A Common Runtime for High Performance Data Analytics	2017	CIDR	0.00010683647
1,864	Relaxed Operator Fusion for In-Memory Databases: Making Compilation, Vectorization, and Prefetching Work Together At Last	2018	VLDB	0.00010280966
1,882	Tuplex: Data Science in Python at Native Code Speed	2021	SIGMOD	0.0001021625
2,129	IDEBench: A Benchmark for Interactive Data Exploration	2020	SIGMOD	9.480002e-05
2,716	Davos: A System for Interactive Data-Driven Decision Making	2021	VLDB	8.2429172e-05
2,838	How to Architect a Query Compiler, Revisited	2018	SIGMOD	8.0408472e-05
2,896	Evaluating End-to-End Optimization for Data Analytics Applications in Weld	2018	VLDB	7.9452051e-05
3,918	On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML	2018	VLDB	6.6315176e-05
4,033	In-RDBMS Hardware Acceleration of Advanced Analytics	2018	VLDB	6.5113267e-05
4,505	SPOOF: Sum-Product Optimization and Operator Fusion for Large-Scale Machine Learning	2017	CIDR	6.1327108e-05
4,774	LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems	2021	SIGMOD	5.9316087e-05
4,924	User-Defined Operators: Efficiently Integrating Custom Algorithms into Modern Databases	2022	VLDB	5.822682e-05
5,476	Containerized Execution of UDFs: An Experimental Evaluation	2022	VLDB	5.4866534e-05
5,731	Babelfish: Efficient Execution of Polyglot Queries	2022	VLDB	5.3502065e-05
6,298	Hillview: A trillion-cell spreadsheet for big data	2019	VLDB	5.1226987e-05
6,525	Database Technology for the Masses: Sub-Operators as First-Class Entities	2021	VLDB	5.027205e-05
8,002	Pangea: Monolithic Distributed Storage for Data Analytics	2019	VLDB	4.6088289e-05
8,051	Building Advanced SQL Analytics From Low-Level Plan Operators	2021	SIGMOD	4.5969549e-05
8,078	Meta-Dataflows: Efficient Exploratory Dataflow Jobs	2018	SIGMOD	4.5914967e-05
8,094	Modularis: Modular Relational Analytics over Heterogeneous Distributed Platforms	2021	VLDB	4.5867812e-05
8,583	Efficient Execution of User-Defined Functions in SQL Queries	2023	VLDB	4.4919445e-05
8,626	Adaptive Code Generation for Data-Intensive Analytics	2021	VLDB	4.4829152e-05
9,326	BladeDISC: Optimizing Dynamic Shape Machine Learning Workloads via Compiler Approach	2023	SIGMOD	4.3556432e-05
9,719	Tuplex: Robust, Efficient Analytics When Python Rules	2019	VLDB	4.2980763e-05
9,762	QURE: AI-Assisted and Automatically Verified UDF Inlining	2025	SIGMOD	4.2856106e-05
10,969	Query Compilation Without Regrets	2024	SIGMOD	4.1945683e-05
11,288	To UDFs and Beyond: Demonstration of a Fully Decomposed Data Processor for General Data Wrangling Tasks	2023	VLDB	4.1945683e-05

Outgoing Citations (Sorted by Pagerank)

Showing 12 of 12 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
22	SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets	2008	VLDB	0.0008456613
60	Efficiently Compiling Efficient Query Plans for Modern Hardware	2011	VLDB	0.00064439773
413	HaLoop: Efficient Iterative Data Processing on Large Clusters	2010	VLDB	0.00023904409
704	Building Efficient Query Engines in a High-Level Language	2014	VLDB	0.00017900583
795	Conjunctive Selection Conditions in Main Memory	2002	PODS	0.00016600368
913	Tenzing A SQL Implementation On The MapReduce Framework	2011	VLDB	0.00015408131
979	Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads	2012	VLDB	0.0001488055
1,044	DimmWitted: A Study of Main-Memory Statistical Analytics	2014	VLDB	0.00014475229
3,882	Micro Adaptivity in Vectorwise	2013	SIGMOD	6.6690423e-05
4,493	ASTERIX: An Open Source System for "Big Data" Management and Analysis (Demo)	2012	VLDB	6.141595e-05
5,387	Performance Analysis of a Relational Data Base Management System	1979	SIGMOD	5.5373368e-05
6,821	Hadoop's Adolescence: An analysis of Hadoop usage in scientific workloads	2013	VLDB	4.9156923e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
2,383	How to Architect a Query Compiler	2016	SIGMOD	8.9294108e-05
11,288	To UDFs and Beyond: Demonstration of a Fully Decomposed Data Processor for General Data Wrangling Tasks	2023	VLDB	4.1945683e-05
1,882	Tuplex: Data Science in Python at Native Code Speed	2021	SIGMOD	0.0001021625
6,863	Declarative Sub-Operators for Universal Data Processing	2023	VLDB	4.905092e-05
10,459	UDFBench: A Tool for Benchmarking UDF Queries on SQL Engines	2025	SIGMOD	4.1945683e-05
6,645	Functional-Style SQL UDFs With a Capital 'F'	2020	SIGMOD	4.978205e-05
9,763	The UDFBench Benchmark for General-purpose UDF Queries	2025	VLDB	4.2856106e-05
6,189	Accelerating Python UDFs in Vectorized Query Execution	2022	CIDR	5.1647573e-05
2,418	Tupleware: "Big" Data, Big Analytics, Small Clusters	2015	CIDR	8.8556595e-05
8,583	Efficient Execution of User-Defined Functions in SQL Queries	2023	VLDB	4.4919445e-05