An Architecture for Compiling UDF-centric Workflows

Summary: An architecture to automatically compile UDF-centric workflows for complex analytics, targeting computation bottlenecks. Data/UDF/hardware-aware optimizations produce per-workflow code in TUPLEWARE, achieving up to three orders of magnitude speedups against alternatives. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 11025
Venue: VLDB
Year: 2015
Pagerank: 0.00010243959
Overall Rank: 1,875 | 86.98%
DOI: -

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 33 of 33 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
101	The Case for Learned Index Structures	2018	SIGMOD	0.00049778866
557	SystemML: Declarative Machine Learning on Spark	2016	VLDB	0.00020186115
848	Everything You Always Wanted to Know About Compiled and Vectorized Queries But Were Afraid to Ask	2018	VLDB	0.00015933538
1,351	The End of Slow Networks: It's Time for a Redesign	2016	VLDB	0.00012439556
1,534	Data Management in Machine Learning: Challenges, Techniques, and Systems	2017	SIGMOD	0.00011462072
1,666	HELIX: Holistic Optimization for Accelerating Iterative Machine Learning	2019	VLDB	0.00010955907
1,751	Weld: A Common Runtime for High Performance Data Analytics	2017	CIDR	0.00010673874
1,865	Relaxed Operator Fusion for In-Memory Databases: Making Compilation, Vectorization, and Prefetching Work Together At Last	2018	VLDB	0.00010271333
1,884	Tuplex: Data Science in Python at Native Code Speed	2021	SIGMOD	0.00010206514
2,126	IDEBench: A Benchmark for Interactive Data Exploration	2020	SIGMOD	9.4814404e-05
2,720	Davos: A System for Interactive Data-Driven Decision Making	2021	VLDB	8.2349824e-05
2,843	How to Architect a Query Compiler, Revisited	2018	SIGMOD	8.0334687e-05
2,904	Evaluating End-to-End Optimization for Data Analytics Applications in Weld	2018	VLDB	7.9403097e-05
3,920	On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML	2018	VLDB	6.6246708e-05
4,040	In-RDBMS Hardware Acceleration of Advanced Analytics	2018	VLDB	6.5052227e-05
4,508	SPOOF: Sum-Product Optimization and Operator Fusion for Large-Scale Machine Learning	2017	CIDR	6.1261819e-05
4,779	LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems	2021	SIGMOD	5.9259373e-05
4,930	User-Defined Operators: Efficiently Integrating Custom Algorithms into Modern Databases	2022	VLDB	5.8171482e-05
5,486	Containerized Execution of UDFs: An Experimental Evaluation	2022	VLDB	5.481452e-05
5,741	Babelfish: Efficient Execution of Polyglot Queries	2022	VLDB	5.3450701e-05
6,302	Hillview: A trillion-cell spreadsheet for big data	2019	VLDB	5.1166201e-05
6,525	Database Technology for the Masses: Sub-Operators as First-Class Entities	2021	VLDB	5.0223854e-05
8,005	Pangea: Monolithic Distributed Storage for Data Analytics	2019	VLDB	4.6044087e-05
8,053	Building Advanced SQL Analytics From Low-Level Plan Operators	2021	SIGMOD	4.5925468e-05
8,081	Meta-Dataflows: Efficient Exploratory Dataflow Jobs	2018	SIGMOD	4.5871672e-05
8,098	Modularis: Modular Relational Analytics over Heterogeneous Distributed Platforms	2021	VLDB	4.5824106e-05
8,580	Efficient Execution of User-Defined Functions in SQL Queries	2023	VLDB	4.4876382e-05
8,623	Adaptive Code Generation for Data-Intensive Analytics	2021	VLDB	4.4786182e-05
9,331	BladeDISC: Optimizing Dynamic Shape Machine Learning Workloads via Compiler Approach	2023	SIGMOD	4.351469e-05
9,718	Tuplex: Robust, Efficient Analytics When Python Rules	2019	VLDB	4.2939577e-05
9,764	QURE: AI-Assisted and Automatically Verified UDF Inlining	2025	SIGMOD	4.2815042e-05
10,972	Query Compilation Without Regrets	2024	SIGMOD	4.1905499e-05
11,290	To UDFs and Beyond: Demonstration of a Fully Decomposed Data Processor for General Data Wrangling Tasks	2023	VLDB	4.1905499e-05

Outgoing Citations (Sorted by Pagerank)

Showing 12 of 12 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
22	SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets	2008	VLDB	0.00084679526
59	Efficiently Compiling Efficient Query Plans for Modern Hardware	2011	VLDB	0.0006445664
408	HaLoop: Efficient Iterative Data Processing on Large Clusters	2010	VLDB	0.00023939456
701	Building Efficient Query Engines in a High-Level Language	2014	VLDB	0.00017893039
790	Conjunctive Selection Conditions in Main Memory	2002	PODS	0.0001659522
909	Tenzing A SQL Implementation On The MapReduce Framework	2011	VLDB	0.0001540191
981	Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads	2012	VLDB	0.00014866268
1,044	DimmWitted: A Study of Main-Memory Statistical Analytics	2014	VLDB	0.00014465007
3,881	Micro Adaptivity in Vectorwise	2013	SIGMOD	6.6638918e-05
4,496	ASTERIX: An Open Source System for "Big Data" Management and Analysis (Demo)	2012	VLDB	6.1357056e-05
5,392	Performance Analysis of a Relational Data Base Management System	1979	SIGMOD	5.5320501e-05
6,817	Hadoop's Adolescence: An analysis of Hadoop usage in scientific workloads	2013	VLDB	4.9110239e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
2,383	How to Architect a Query Compiler	2016	SIGMOD	8.9198524e-05
11,290	To UDFs and Beyond: Demonstration of a Fully Decomposed Data Processor for General Data Wrangling Tasks	2023	VLDB	4.1905499e-05
1,884	Tuplex: Data Science in Python at Native Code Speed	2021	SIGMOD	0.00010206514
6,863	Declarative Sub-Operators for Universal Data Processing	2023	VLDB	4.9003859e-05
10,469	UDFBench: A Tool for Benchmarking UDF Queries on SQL Engines	2025	SIGMOD	4.1905499e-05
6,646	Functional-Style SQL UDFs With a Capital 'F'	2020	SIGMOD	4.9734285e-05
9,765	The UDFBench Benchmark for General-purpose UDF Queries	2025	VLDB	4.2815042e-05
6,191	Accelerating Python UDFs in Vectorized Query Execution	2022	CIDR	5.1598046e-05
2,421	Tupleware: "Big" Data, Big Analytics, Small Clusters	2015	CIDR	8.8471956e-05
8,580	Efficient Execution of User-Defined Functions in SQL Queries	2023	VLDB	4.4876382e-05